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Introduction 


The  decay  of  the  families  of  men  who  occupied  conspicuous  positions  in  past  times 
has  been  a  subject  of  frequent  remark,  and  has  given  rise  to  various  conjectures.  It  is 
not  only  the  families  of  men  of  genius  or  those  of  the  aristocracy  who  tend  to  perish, 
but  it  is  those  of  all  with  whom  history  deals,  in  any  way,  even  of  such  men  as  the 
burgesses  of  towns,  concerning  whom  Mr  Doubleday  has  inquired  and  written.  The 
instances  are  very  numerous  in  which  surnames  that  were  once  common  have  since 
become  scarce  or  have  wholly  disappeared.  The  tendency  is  universal,  and,  in 
explanation  of  it,  the  conclusion  has  been  hastily  drawn  that  a  rise  in  physical 
comfort  and  intellectual  capacity  is  necessarily  accompanied  by  diminution  in 
'fertility’  —  using  that  phrase  in  its  widest  sense  and  reckoning  abstinence  from 
marriage  as  sterility.  If  that  conclusion  be  true,  our  population  is  chiefly  maintained 
through  the  ‘proletariat’,  and  thus  a  large  element  of  degradation  is  inseparably 
connected  with  those  other  elements  which  tend  to  ameliorate  the  race.  On  the  other 
hand,  M.  Alphonse  De  Candolle  has  directed  attention  to  the  fact  that,  by  the 
ordinary  law  of  chances,  a  large  proportion  of  families  are  continually  dying  out,  and 
it  evidently  follows  that,  until  we  know  what  that  proportion  is,  we  cannot  estimate 
whether  any  observed  diminution  of  surnames  among  the  families  whose  history  we 
can  trace,  is  or  is  not  a  sign  of  their  diminished  ‘fertility’. 

These  remarks  were  made  by  Francis  Galton  at  a  meeting  of  the  Anthropological 
Institute  of  Great  Britain  and  Ireland  in  1874.  He  was  introducing  a  paper  by  (his 
friend)  the  Revd  H.  W.  Watson,  entitled  ‘On  the  probability  of  the  extinction  of 
families’.  Shortly  before  this  meeting,  Galton  had  posed  the  problem  in 
mathematical  form  in  a  mathematical  journal:  Educational  Times.  According  to 
Galton  this  ‘met  with  poor  success  at  first,  because  the  answer  it  received  was  from 
a  correspondent  who  wholly  failed  to  perceive  its  intricacy,  and  his  results  were 
totally  erroneous’. 

Galton  then  asked  Watson  to  look  at  the  problem,  and  the  result  was  the  paper 
presented  to  the  Anthropological  Institute.  Watson’s  solution  actually  contained  an 
algebraic  error,  and  he  incorrectly  concluded  that  each  family  will  eventually  die 
out  with  probability  1.  As  you  will  see  in  Section  4,  this  is  not  the  case. 

It  has  recently  been  discovered  that  the  Frenchman  Jules  Bienayme  worked  on  this 
same  problem  in  1845  and  appeared  to  be  aware  of  the  correct  result,  though  he 
did  not  publish  his  calculations.  The  model  which  both  Bienayme  and  Watson 
used  is  that  of  a  simple  discrete-time  branching  process,  which  is  known  as  either 
the  Galton-Watson  model  or  sometimes  the  Bienayme-Galton- Watson  model. 

After  Galton  and  Watson’s  paper,  the  subject  was  virtually  ignored  for  about  50 
years.  The  model  was  next  applied  to  the  study  of  genetics  by  R.  A.  Fisher  in  1922 
and  by  J.  B.  S.  Haldane  in  1927.  It  was  Haldane  who  obtained  an  essentially 
correct  solution  to  the  problem  that  Watson  had  got  wrong.  Later,  in  1938,  the 
great  Russian  probabilist  A.  Kolmogorov  worked  on  the  problem;  it  was  he  who 
introduced  the  name  ‘branching  process’.  Branching  processes  were  applied  by  the 
team  of  physicists  working  with  J.  R.  Oppenheimer  to  develop  models  for  nuclear 
chain  reactions.  During  the  last  30  years  or  so,  there  have  been  hundreds  of 
research  papers  on  discrete-  and  continuous-time  branching  processes,  extending 
the  original  Galton-Watson  model,  and  the  models  have  been  applied  to  many 
different  situations. 

In  Section  1,  the  Galton-Watson  model  for  a  discrete-time  branching  process  is 
defined  and  the  properties  of  the  model  are  observed  for  some  specific  simple 
cases.  Band  B  of  the  video-cassette  is  associated  with  Subsection  1.2;  you  should 
allow  15  minutes  for  it.  In  Section  3  the  distribution  of  the  number  of  individuals 
in  the  nth  generation  is  derived.  This  involves  the  use  of  probability  generating 
functions,  which  are  revised  in  Subsection  2.1;  further  results  about  them  are 
obtained  in  Subsection  2.2.  These  results  are  also  applied  to  branching  processes  in 
Section  4,  in  which  the  probability  that  a  family  will  eventually  die  out  is 
calculated.  Section  5  extends  the  Galton-Watson  model  in  various  ways,  and 
looks  briefly  at  other  branching  process  models. 

Section  2  may  require  more  than  average  study  time,  particularly  if  you  have 
forgotten  about  probability  generating  functions.  Sections  3  and  4  contain  some 
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quite  difficult  ideas,  but  the  results  are  straightforward  to  apply.  Sections  1  and  5 
are  both  relatively  short. 

There  is  no  audio-tape  component  associated  with  this  unit. 

Several  of  the  arguments  presented  in  this  unit  use  results  which  are  stated  in  the 
Handbook,  so  make  sure  you  have  it  to  hand  when  studying  this  unit. 


1  The  Galton-Watson  model 


In  this  section  the  Galton-Watson  model  for  a  discrete-time  branching  process, 
which  is  the  subject  of  this  unit,  is  introduced.  In  Subsection  1.1,  some  of  the  many 
situations  in  which  the  model  has  been  applied  are  described,  and  in  Subsection 
1.2,  the  model  is  stated  and  some  simple  examples  of  its  behaviour  are  shown. 

1.1  Some  examples 

(a)  Human  families 

A  branching  process  can  be  understood  most  easily  by  thinking  of  a  family  tree. 

Suppose  the  family  starts  off  with  one  man  or  woman,  Gabon’s  man  of  genius  or 
the  first  king  of  a  dynasty  perhaps,  and  that  this  person,  the  ancestor,  has  a 
random  number  of  children,  the  first  generation.  Then  each  of  these  children  may 
have  children  who  form  the  second  generation,  and  so  the  process  continues.  It 

can  be  represented  diagramatically  as  a  tree  with  the  children  branching  out  from  See  Figure  1.1  on  page  6,  for 

each  parent.  If  there  is  a  non-zero  probability  that  each  person  may  have  no  example. 

children,  then  there  is,  of  course,  a  possibility  that  the  family  will  eventually  die 

out.  This  was  the  problem  particularly  studied  by  Watson  and  Haldane.  Watson 

was  interested  in  family  surnames  or  hereditary  peerages,  which  in  the  UK  are 

passed  down  only  through  the  male  line,  so  in  that  situation  the  branching  process 

would  include  only  male  children.  We  can  ask  questions  about  the  distribution  of 

the  number  of  children  born  in  various  generations,  whether  the  family  eventually 

becomes  extinct,  the  total  number  of  descendants  after  several  generations  and 

whether  this  number  is  eventually  likely  to  increase  indefinitely. 

( b )  Genetics 

In  1922,  R.  A.  Fisher  applied  exactly  the  same  model  to  the  study  of  genetics. 

Every  gene  in  any  organism  has  a  chance  of  reappearing  in  0,  1,  2,  ...  of  its 
progeny  and  then  of  being  passed  on  to  subsequent  generations.  The  branching 
process  model  is  particularly  useful  when  considering  mutations;  a  mutation  is  a 
spontaneous  transformation  of  a  particular  gene  into  a  different  form,  and  this  can 
occur  by  chance  at  any  time.  Most  mutations  are  harmful,  but  some  are  beneficial 
and  can  lead  to  an  evolutionary  change  in  a  species.  The  mutant  gene  becomes  the 
ancestor  of  a  branching  process,  and  geneticists  are  paiticularly  interested  in  the 
probability  of  ultimate  extinction  of  the  mutation.  This  application  will  be 
discussed  in  Unit  12. 

(c)  Electron  multipliers 

An  electron  multiplier  is  a  device  for  amplifying  a  weak  electric  current  (flow  of 
electrons).  It  can  be  used  to  detect  a  weak  current  or  to  amplify  a  radio  signal,  for 
example.  It  consists  of  a  series  of  parallel  electrically-charged  metal  plates  which 
are  placed  in  the  path  of  the  electron  flow.  When  one  electron  in  the  current 
strikes  the  first  plate,  a  random  number  of  electrons  are  ejected,  and  these  can  be 
thought  of  as  forming  the  first  generation.  These  electrons  then  strike  the  second 
plate,  and  more  electrons  are  then  emitted,  forming  the  second  generation,  etc.  The 
output  current  after  the  electron  flow  has  passed  through  the  multiplier  can  be 
measured  or  the  radio  signal  can  be  interpreted.  A  photomultiplier  is  triggered  by 
light  and  works  on  the  same  principle. 
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(d)  Nuclear  chain  reactions 

In  nuclear  fission,  a  nucleus  is  split  by  chance  collision  with  a  neutron.  This  fission 
produces  a  random  number  of  new  neutrons.  These  may  then  collide  with  other 
nuclei,  producing  further  fissions  and  more  neutrons.  If  the  process  of  fission  is  not 
controlled,  the  number  of  neutrons  may  increase  rapidly  and  lead  to  an 
explosion — an  atomic  bomb. 

(e)  Chemical  chain  reactions 

Chemical  explosions  can  also  involve  branching  processes.  For  example,  hydrogen 
(H2)  burns  in  oxygen  (02)  to  make  water  (H20)  according  to  the  overall  equation 
2H2  +  02  — *  2H20.  A  mixture  of  hydrogen  and  oxygen  can  detonate  violently 
because  the  mechanism  involves  the  production  of  highly  active  intermediates  or 
radicals,  denoted  below  by  an  asterisk.  Initially  produced  by  a  lighted  match  (or  a 
spark,  or  even  the  solid  wall  of  the  container),  each  such  radical  begins  a  chain 
reaction  which  may  produce  more  radicals  than  it  consumes,  until  the  hydrogen  or 
oxygen  is  exhausted: 

H*  +  02  — ►  HO*  +  O*, 

O*  +  H2  -*  HO*  +  H*, 

HO*  +  H2->  H20  +  H*. 

Such  branching  propagates  the  chain  reaction  faster  and  faster,  resulting  in  an 
explosion.  In  a  space  rocket,  this  explosion  is  controlled  to  provide  the  thrust. 

(/)  The  spread  of  rumours  and  diseases 

An  individual  who  knows  an  item  of  gossip  or  news  (or  who  has  a  cold)  may  tell  it 
to  other  individuals  (or  infect  them).  These  people  in  turn  pass  it  on  to  others  who 
form  the  second  generation,  and  so  on.  If  the  population  is  large,  certain  aspects  of 
this  process  may  be  studied  using  the  Galton-Watson  model. 


1.2  The  model 

In  this  subsection  a  probability  model  will  be  developed  which  will  be  used  to 
describe  a  simple  branching  process  and  to  obtain  results  about  the  way  it 
behaves.  In  the  branching  process,  it  will  be  assumed  that  each  individual  (animal, 
particle,  gene,  bacterium,  molecule,  etc.)  produces  a  number  of  offspring  (progeny, 
descendants,  particles,  etc.)  after  a  length  of  time  called  the  ‘generation  time’.  This 
length  of  time  may  be  fixed  or  random,  and  indeed,  as  in  human  families,  not  all 
offspring  need  be  born  simultaneously.  However,  each  individual  of  one  generation 
is  to  be  thought  of  as  producing  offspring  which  form  the  following  generation, 
and  then  taking  no  further  part  in  the  process.  The  process  can  therefore  be 
classified  as  discrete,  and  ‘time’  is  the  generation  number  (0,  1,  2,...). 

Let  X  denote  the  number  of  offspring  produced  by  an  individual,  and  let  p(x) 

denote  the  probability  P(X  =  x)  that  an  individual  has  x  offspring.  Thus 

00 

Y  P(x)  =  an<3  P  is  called  the  ‘offspring  probability  function’. 

jc  =  0 

It  will  be  assumed  that 

(i)  the  offspring  probability  function,  p,  is  the  same  for  all  individuals; 

(ii)  all  individuals  reproduce  independently  of  one  another. 

For  the  first  four  sections  of  this  unit  it  will  also  be  assumed  that 

(iii)  the  process  starts  with  a  single  individual  in  generation  zero,  sometimes 
referred  to  as  the  ancestor. 

The  ancestor  has  offspring  according  to  Assumption  (i);  these  form  the  first 
generation.  Each  of  these  offspring  then  also  has  offspring  according  to 
Assumptions  (i)  and  (ii);  these  form  the  second  generation,  and  so  on.  These  are  the 
assumptions  of  the  Galton-Watson  model  for  a  discrete-time  branching  process. 

For  the  remainder  of  this  unit,  such  a  process  will  normally  be  referred  to  simply 
as  a  branching  process. 


The  number  of  individuals  in  the  nth  generation,  that  is  at  time  t  =  ny  will  be 

denoted  by  Zn.  The  process  { Zn ;  n  =  0,  1,...}  is  therefore  a  stochastic  process.  By 

Assumption  (iii),  Z0  =  1.  If  no  individuals  of  the  nth  generation  have  offspring, 

then  Zm  =  0  for  m  >  n ,  and  the  process  terminates.  A  second  random  process  is 

{ Tn;  n  =  0,  1,...},  where  Tn  is  the  total  number  of  individuals  to  have  been  bom  up 

to  and  including  the  nth  generation:  Tn  =  1  +  Zi  +  Z2  +  . . .  T-  Z„.  T0  =  Z0  =  1 

« 

Any  realization  of  a  branching  process  can  be  represented  by  a  diagram  such  as 
Figure  1.1. 

z„  =  I 
z.  =  3 

Z,  =  7 
Z,  =  10 

Figure  1.1  A  realization  of  a  branching  process 

In  this  particular  realization,  the  initial  individual  has  three  offspring,  so  Zx  —  3; 
these  have  two,  one,  four  offspring  respectively,  so  Z2  =  7;  and  Z3  =  10.  When  no 
line  appears  below  a  dot,  this  indicates  that  the  corresponding  individual  has  no 
offspring.  The  lines  below  the  third  generation  individuals  indicate  that  the  process 
is  continuing. 

What  properties  can  be  derived  from  the  probability  model  that  will  give  us  some 
information  about  branching  processes?  Can  the  probability  distribution  of  Z„  be 
specified?  If  not,  can  its  mean  and  variance  (and  higher  moments  if  required)  be 
calculated?  What  happens  if  the  process  continues  for  many  generations?  The 
original  question  posed  by  Galton  was  whether  all  surnames  would  eventually  die 
out.  Is  this  certain  to  happen,  or  can  there  be  a  population  explosion?  We  shall 
investigate  these  questions  in  the  next  three  sections,  and  in  Section  5  we  shall 
look  briefly  at  ways  in  which  the  model  can  be  extended. 

For  the  rest  of  this  section  we  shall  observe  how  the  process  develops  in  some 
simple  specific  cases. 


Example  1.1 

Consider  the  case  where  each  individual  can  have  only  0,  1  or  2  offspring.  Let  the 
offspring  distribution  be  p( 0)  =  r,  p(l)  =  q,  p(2)  =  p  where  p  +  q  +  r  =  1.  Thus,  for 
the  first  generation, 

P(Z1  =  0  )  =  r,  P{Z1  =  1  )  =  q  and  P{ZX  =  2)  =  p. 

The  only  possible  outcomes  for  the  first  two  generations  are  shown  in  Figure  1.2. 
Note  that,  for  example,  outcomes  (vi)  and  (vii)  should  be  considered  separately.  In 
each  of  these  outcomes,  Zx  =  2,  which  has  probability  p.  as  shown  in  the  figure. 
Then  one  of  these  has  one  offspring  and  one  has  no  offspring,  so.  using 
Assumption  (ii),  the  probability  of  outcome  (vi),  and  of  outcome  i  vii  i.  is  pqr. 


(*x)  (x)  (xi)  (xii)  (xiii) 


Figure  1.2  The  possible  outcomes  of  the  process  of  Example  1.1 
Question  1.1  Write  down  the  probabilities  of  outcomes  (i),  (ix),  (xi).  □ 
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Collecting  the  results  together,  we  can  find  the  probability  function  for  Z2.  For 
example,  outcomes  (i),  (ii)  and  (v)  contribute  to  Z2  =  0,  so  the  probability  of  this  is 
r  +  qr  +  pr2.  The  other  probabilities  may  be  calculated  similarly.  The  probability 


function  of  Z2  is  as  follows. 

z 

0 

1 

2 

3  4 

P(Z2  =  z) 

r  -f  qr  4-  pr2 

q 2  +  2  pqr 

pq  4-  pq2  +  2  p2r 

2 P2q  p 3 

This  is  not  a  very  simple  form,  and  to  derive  the  distributions  of  Z3,  Z4,...  in  this 
way  becomes  progressively  more  complicated. 

Question  1.2  Calculate  the  probability  that  Z3  =  0  for  the  situation  considered  in 
Example  1.1.  □ 


Obviously  this  is  not  a  practical  method  of  deriving  the  distribution  of  Z„,  and 
other  methods  will  be  developed  later  in  the  unit.  However,  it  is  instructive  to  look 
at  some  specific  numerical  cases.  Figure  1.3  shows  the  probability  distributions  of 
Z6  using  the  offspring  distribution  of  Example  1.1  with  various  values  of  p,  q,  r. 
These  distributions,  which  were  calculated  by  computer,  are  also  shown  below. 

4  Probability  density 


Since  each  individual  may  have 
two  descendants,  Z6  may  be  as 
large  as  26  =  64;  so,  for  example, 
the  heading  *  >  4’  below  means 
the  interval  [4, 64]. 


(i) 

r  =  0.5, 

q  =  0.25,  p  =  0.25 

0.8 -j 

z 

0123  >4 

0.6- 

(i)  r  =  0.5,  q  =  0.25,  p  =  0.25 

prob. 

0.924  0.023  0.028  0.011  0.014 

0.4- 

0.2- 

- r~ 

0 

1 

2  3 

11  ■  >» 

Z 

i 

f  Probability  density 

1.0- 

(ii) 
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(ii)  r  =  0.25,  q  =  0.5,  p  =  0.25 

prob. 

0.641  0.100  0.098  0.064  0.042  0.025  0.030 

0.4- 
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Figure  13  Probability  distributions  of  Z6:  four  cases 
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The  process  has  different  patterns  of  development  in  these  four  cases.  In  case  (i), 
when  p( 0)  =  0.5,  the  process  is  very  likely  to  have  died  out  by  the  sixth  generation. 

Even  if  extinction  has  not  occurred,  it  is  unlikely  that  there  are  more  than  two 
individuals  alive.  In  case  (ii),  the  same  general  pattern  is  apparent,  though 
extinction  is  less  likely  to  have  occurred  (probability  0.641  compared  to  0.924  for 
case  (i))  and  the  spread  of  size  of  population,  if  it  is  not  extinct,  is  somewhat 
•  greater. 

In  case  (iii),  when  an  individual  is  most  likely  to  have  two  offspring  (since  p  =  0.5), 
the  pattern  has  changed.  There  is  a  probability  of  nearly  \  that  extinction  will  have 
occurred,  but  if  not,  generation  six  may  be  quite  large;  it  is  unlikely  to  contain 

only  one  individual  and  four  is  the  commonest  size.  In  case  (iv),  the  pattern  is  In  case  (iii),  even  sizes  are  slightly 

similar  to  case  (iii)  but  the  effects  are  more  pronounced.  There  is  a  probability  of  more  probable  than  odd  sizes 
0.125  that  the  process  has  died  out,  but  a  small  number  of  individuals  is  very  because  p{  2)  >  p{  1). 

unlikely.  The  commonest  size  is  between  about  21  and  35.  □ 

So  far  we  have  considered  the  simple  case  where  each  individual  can  have  only  0, 

1  or  2  descendants.  When  more  descendants  are  permitted,  the  complexity  rapidly 
increases,  as  the  following  question  illustrates. 

Question  1.3  Suppose  that  each  individual  in  a  branching  process  starting  with 
one  individual  in  generation  zero  can  have  0,  1,  2  or  3  offspring,  with  probabilities 
p(0),  p(l),  p( 2)  and  p(3). 

(i)  Draw  diagrams  of  all  possible  outcomes  in  which  Z2  =  2. 

(ii)  Calculate  the  probability  that  Z2  =  2.  □ 


13-16  21-24  29-32  37-40 

Figure  1.4  Probability  distributions  of  Z4:  two  cases 

Figure  1.4  shows  two  distributions  of  Z4,  the  size  of  the  fourth  generation  of  a 
simple  branching  process,  when  an  individual  may  have  up  to  four  offspring.  The 
distributions  show  the  same  basic  features  as  Figure  1.3.  In  case  (i),  where  the 
probability  of  no  offspring  is  high,  there  is  a  probability  of  about  §  that  the 
process  is  extinct  by  the  fourth  generation,  and  the  size  is  very  unlikely  to  be 
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greater  than  ten.  On  the  other  hand,  in  case  (ii),  where  there  is  an  even  spread  of 
probabilities  for  number  of  offspring,  there  is  a  probability  of  only  just  over  £  that 
the  process  is  extinct.  The  variance  of  Z4  is  obviously  large  in  this  case,  and  Z4 
may  be  as  large  as  44  =  256,  though  the  commonest  values  are  about  9  to  16. 

Each  of  the  distributions  illustrated  in  Figure  1.4  took  about  eight  minutes  to 
calculate  on  a  mainframe  computer.  Clearly  this  is  not  a  practical  method  of 
calculating  the  distribution  of  Z„,  so  in  Section  3  another  method  will  be 
developed. 

On  the  video-cassette,  Band  B,  you  will  see  some  simulations  of  branching 
processes.  This  is  a  suitable  point  at  which  to  watch  it. 


1 

2  The  probability  generating  function 


In  Section  1  the  concept  of  a  branching  process  was  introduced  and  a  probability 
model  was  developed  to  describe  this  process.  We  calculated  the  distribution  of  the 
number  of  offspring  for  a  few  simple  cases;  it  became  apparent  that  this  method 
was  not  practicable  for  more  than  three  or  four  generations.  In  this  section, 
the  foundations  are  laid  for  a  method,  to  be  developed  in  Section  3,  which  will  give 
many  general  results  about  branching  processes. 

The  distribution  of  the  number  of  individuals  in  the  first  generation,  Z1;  is  the 

same  as  the  offspring  probability  distribution.  However,  the  distribution  of  Z2  is  See  Example  1.1. 
not  so  simple;  Z2  is  the  sum  of  the  numbers  of  offspring  of  all  members  of  the  first 
generation.  If  the  ith  member  of  the  first  generation  has  X,  offspring,  then 

Z2  =  Xt  +  X2  +  ...  +  XZl.  (2.1) 

So  Z2  is  the  sum  of  a  random  number  of  random  variables.  In  order  to  express 
the  distribution  of  the  sum  of  a  random  number  of  random  variables,  we  shall  use 
probability  generating  functions,  and  these  are  revised  in  Subsection  2.1.  In 
Subsection  2.2  the  probability  generating  function  of  the  distribution  of  the  sum  of 
a  random  number  of  variates  is  derived  (and  this  result  is  applied  to  branching 
processes  in  Section  3). 


2.1  Basic  properties 


Suppose  that  the  discrete  random  variable  X  takes  values  in  the  range  {0, 1,...} 
and  has  probability  function  p(x).  Then  its  probability  generating  function  (p.g.f.) 
n,(s)  is  defined  as 

11,(5)  =  E(sx).  (2.2) 

It  is  usual  to  omit  the  subscript  X  if  this  leads  to  no  ambiguity. 

In  order  to  establish  properties  of  the  p.g.f.,  and  for  calculations,  the  following 
equivalent  expression  is  required: 

00 

n(s)  =  Y  p(x)sx-  (2.3) 

JC  =  0 

The  probability  generating  function,  II(s),  is  a  function  of  the  dummy  variable  s, 
which  may  take  values  satisfying  \s\  <1.  When  s  =  0,  11(0)  =  p( 0),  the  probability 
that  X  takes  the  value  0.  When  s  =  1, 

n(i)  =  £  P(x) 

x  =  0 

=  1,  since  p  is  a  probability  function. 

For  each  x,  the  coefficient  of  sx  in  Equation  (2.3)  is  p(x),  the  probability  that  X 
takes  the  value  x.  Thus,  the  probability  generating  function  is  unique  to  a 
distribution,  in  that  the  p.g.f.  uniquely  determines  a  distribution  and  vice  versa. 

This  property  explains  why  the  p.g.f.  is  so  important,  and  clearly  it  is  necessary  to 
know  when  a  power  series  specifies  a  p.g.f.  The  required  result  is  as  follows. 


£[#W]  =  Z  #(*)/>(*);  see  Unit  U 

x  =  0  V 

Equation  (F8).  ^  ) 

U(s)  may  exist  on  intervals 
containing  [—1,1],  but  values  of  s 
outside  [  —  1, 1]  are  of  no  interest 
here. 
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If  a  power  series  £  a tV  satisfies  the  conditions 

i  =  0 

0  <  a{  <  1  for  i  =  0,  1,2,... 

and 

00 

£  fli  =  !» 
i  =  0 

then  the  power  series  specifies  a  p.g.f. 

(You  will  need  to  use  this  result  in  Section  3.) 

Many  standard  distributions  have  p.g.f.’s  which  take  simple  forms,  and  we  shall 
now  calculate  some  of  these. 


Example  2.1  The  p.g.f.  of  the  binomial  distribution 

If  X  ~  B(n ,  p\  then  its  p.g.f.  is  given  by 

n(s)  =  £  p(x)sx 

x  =  0 

=  iQw1. 

By  the  Binomial  Theorem,  this  is  equal  to  (<?  +  ps)n.  (As  a  check, 

11(1)  =  (q  +  p)n  =  1.)  So  the  p.g.f.  of  the  binomial  distribution  is  ( q  +  ps)n.  □ 

Question  2.1  If  X  has  a  Poisson  distribution  with  mean  p,  calculate  its  p.g.f. 
(Hint:  **-l  +e  +  ^  +  . o 


The  p.g.f.’s  of  some  common  distributions  are  given  in  Table  2.1,  to  which  you  will 
need  to  refer  often  in  this  unit. 


Table  2.1  Probability  generating  functions  of  some  standard  distributions 

Distribution  Probability  Range  p.g.f. 

function 


Bernoulli,  B(l,p) 
Binomial,  B(n,p) 

Poisson(/d 
Geometric,  G{(p) 
Negative  binomial 

Geometric,  G0(p) 
Negative  binomial 


PV* 

("W' 

x\ 

qx~lp 


x  —  1 
r  -  1 


qx  rpr 


pxq 


r  +  x  —  1 
r  —  1 


pxqr 


0,1 

0,1,...,  n 
0,1,... 
1,2,... 
r,r  +  1,. 

0,1,... 

0,1,... 


q  +  ps 
{q  +  ps)n 

PS 

1  —  qs 


The  probability  generating  function  is  a  mathematical  tool  for  obtaining  many 
useful  results  about  distributions.  The  distribution  of  a  linear  function  of  a  random 
variable  can  be  obtained  using  the  p.g.f. 

Question  2.2  If  Y  =  aX  4-  b ,  where  a  and  b  are  positive  integers  or  zero,  show 
that  the  p.g.f.  of  Y  is  given  by 

ny(s)  =  s*n*(,s*).  (2.4) 

(Hint:  Use  the  definition  of  a  p.g.f.,  Equation  (2.2).)  □ 


The  Binomial  Theorem  is  stated  in 
the  Handbook. 


The  entries  in  this  table  also  appear 
in  the  Handbook. 
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The  p.g.f.  can  be  used  to  calculate  the  moments  of  a  distribution.  From 
Equation  (2.3), 

n(s)  =  f,  p(x)  sx- 

x  =  0 

differentiating  this  with  respect  to  s  gives 
n'(s)  =  E  xp^s*-1, 

x=0 

and  putting  s  =  1,  we  have 

n'(i)  =  £  xpM- 

x  =  0 

So 

E(X )  =  IT(1).  (2.5a) 

Thus,  the  mean  can  be  found  by  differentiating  the  p.g.f.  and  setting  s  equal  to  1. 

This  result  may  also  be  derived  from  the  definition  (2.2),  without  the  need  for 
summation  signs,  and  we  shall  use  this  approach  to  do  this  and  to  obtain  a 
formula  for  the  variance  of  a  distribution. 

Since  FI(s)  =  E(sx), 

n  \s)  =  E(Xsx~l)9 

and  differentiating  with  respect  to  s  a  second  time, 

U"(s)  =  E[X{X  -  1  )sx~2l 
Setting  s  =  1  leads  to 

ri'(i)  =  e(x) 

and 

IT'(l)  =  E[X(X  -  1)] 

=  E(X2)  -  E(X); 
so 

E(X2)  =  n"(l)  +  E(X). 

Now  V(X)  =  E(X2)  —  [E(X)Y,  and  substituting  for  E(X2)  leads  to 

V(X)  =  n"(l)  +  E(X)  -  IE(X)Y.  (2.6a) 

Putting  fL  =  E(X)  and  a2  =  V(X)  in  Formulas  (2.5a)  and  (2.6a)  gives 

(2.5b) 
(2.6b) 

Question  2.3  Calculate  the  mean  n  and  variance  cr2  of  the  geometric  distribution 
G0(p),  using  Formulas  (2.5b)  and  (2.6b).  □ 

Probability  generating  functions  can  be  used  to  find  the  distribution  of  a  sum  of 
independent  discrete  random  variables.  Suppose  that  X  and  Y  are  independent 
discrete  variates,  each  with  range  [0,  1,...},  and  that  Z  =  X  +  Y.  Let  the 
corresponding  p.g.f.’s  be  Hx(s\  ny(s),  nz(s).  Then 

n  z(s)  =  E(sz) 

=  E(sx  +  y) 

=  E(sxsY) 

=  E(sx )  E(sY ),  since  X  and  Y  are  independent, 

=  n^(5)  Fly(s). 

So  the  p.g.f.  of  Z  is  equal  to  the  product  of  the  p.g.f.’s  of  X  and  Y.  If  the  p.g.f.  of  Z 
can  be  recognized  as  the  p.g.f.  of  some  known  distribution,  then,  by  the  uniqueness 
of  the  p.g.f.,  this  is  the  distribution  of  Z. 
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This  result  extends  to  the  sum  of  any  fixed  number  of  independent  discrete 
random  variables,  and  is  particularly  useful  for  the  sum  of  identically  distributed 
variates.  These  results  are  as  follows. 

t 


If  Z  =  Yj  Xh  where  Xl9  X2,  . ..,  Xn  are  independent  discrete  variates  with 

i  —  1 

p.g.f.  s  ITXl(s),  II*2(s),  nXn(s),  then 

Hz(s)  =  nXl(s)  x  nX2(s)  x  ...  x  UXn(s).  (2-7) 

In  particular,  if  Xl9  X2>. . . , Xn  are  identically  distributed  with  p.g.f.  n*(s), 
then 

nz(s)  =  (n*(s))n.  (2.8) 


Question  2.4  If  Xi,X2,.. .,Xn  are  independent  Gfip)  variates,  find  the  p.g.f.  of 

n 

Z  =  Yj  X(  and  hence  identify  the  distribution  of  Z.  □ 

i  =  1 

Question  2.5  Find  and  identify  the  distribution  of  the  sum  of  n  independent 
Poisson  variates,  with  parameters  pi,  □ 

During  the  remainder  of  this  course,  the  p.g.f.  will  be  used  on  many  occasions  and 
it  will  become  apparent  what  a  useful  and  powerful  tool  it  is  in  probability  theory 
and  its  applications.  In  the  next  subsection,  you  will  see  how  it  is  used  to  find  the 
distribution  of  the  sum  of  a  random  number  of  random  variables. 


2.2  The  probability  generating  function  of  a  random  sum  of  random 
variables 


You  saw  in  Equation  (2.1)  that  the  number  of  offspring  of  the  second  generation  in 
a  branching  process  is  the  sum  of  a  random  number  of  random  variables,  and  in 
this  subsection  the  method  for  finding  the  p.g.f.  of  such  a  sum  is  developed. 


Suppose  that  {Xf:  i  =  1,2,...}  is  a  set  of  independent  identically  distributed 
discrete  variates  each  with  range  {0,  1,...},  and  that 

Z  =  AT i  +  X2  +  ...  -f-  XN,  (2.9) 


where  N  is  also  a  discrete  random  variable  with  range  {0,  1,...}.  Then  Z  is  a 
random  sum  of  random  variables,  and  is  also  a  discrete  variate  with  range 
{0,1,...}. 


If  N  =  0,  Equation  (2.9)  does  not  apply;  in  this  case  Z  is  defined  as  Z  =  0. 

In  Unit  2,  Subsection  M,  formulas  were  derived  for  calculating  the  mean  and 
variance  of  Z  for  the  special  case  where  N  has  a  Poisson  distribution.  We  can  now 
use  p.g.f.’s  to  obtain  results  about  the  distribution  of  Z  for  any  discrete  distribution 
of  N. 


The  p.g.f.’s  of  each  Xh  N  and  Z  will  be  denoted  by  II^s),  n^s)  and  IT^s) 
respectively.  Our  problem  is  to  express  Ilz(s)  in  terms  of  II^s)  and  n^s).  Since  N 
is  a  random  variable,  Result  (2.8),  which  applies  only  for  fixed  n,  cannot  be  used 
directly.  However,  as  you  will  see,  this  result  is  a  critical  one  in  the  work  which 
follows.  The  p.g.f.  of  Z  may  be  written  as 

nz(s)  =  £  p(z  =  z)s*. 

z  —  0 


Now,  since  N  must  take  some  value  in  {0,  1,...},  we  have 

oO 

P{Z  =  z)=  Y  p(z  =  z\N  =  n)p(N  =  n) 

n  —  0 

from  the  Theorem  of  Total  Probability. 
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Combining  these  results, 

oo  oo 

nz(s)  =  Y  Y  P(Z  =  z  N  =  n)  P(N  =  «)s; 


z  =  0  n  =  0 

QO 


00 


=  £  P(N  =  n)  £  P(Z  =  z  |  AT  =  n)sz. 


n  =  0 


z  —  0 


reversing  the  order  of  the  summation  signs  and  noting  that  P(N  =  n)  is 
independent  of  the  value  of  Z. 


Consider  the  summation  with  respect  toz:  ^  P(Z  =  z\N  =  n)sz.  The  conditional 

z  —  O 

probability  P(Z  =  z  |  N  =  n)  is  equal  to  P(Xi  +  X2  +  . . .  +  X„  =  z)  and 
•^"l  +  X2  +  •  •  •  +  is  the  sum  of  a  fixed  number,  n,  of  random  variables.  So  the 
summation  is  the  p.g.f.  of  Xt  +  X2  +  ...  +  X„,  and  from  Result  (2.8),  this  p.g.f.  is 
(ni(s)f.  Thus 

Y  P(Z  =  z\N  =  n)s2  =  (Ux(s)Y. 

z  =  0 

Substituting  this  in  the  expression  for  n^s),  we  obtain 

oo 

n z(s)  =  X  P(N  =  n)(n*(s))\ 

n  =  0 

Now  nN(s)  is  given  by 

nN(s)  =  Y  p(N  =  «)*"> 

«  =  0 

so  the  expression  for  nz(s)  is  similar  in  form  to  that  for  II N(s),  with  s  replaced  by 
Ux(s\  and  this  suggests  composition  of  functions.  Consider  n^II^s)): 

iMrws))  =  f ]p(n  =  «)(nx(s))" 

n  —  0 

=  nz(s). 

The  function  nz  is  thus  the  composition  n^oll^. 


The  p.g.f.  of  Z  can  be  found  using  the  above  result  and  so,  at  least  in  theory,  the 
distribution  of  Z  is  known.  This  important  result  is  displayed  below. 


If  Z  is  the  sum  (X1  +  X2  +  ...  +  XN)  of  N  independent  discrete  variates  with 
range  {0, 1,...},  each  having  p.g.f.  ITr(s),  where  N  is  a  random  variable  with 
p.g.f.  EWs)  and  range  {0, 1,...},  then  the  p.g.f.  of  Z  is  given  by 

nz(s)  =  nN(n*(s)).  (2.10) 

The  variate  Z  is  said  to  have  a  compound  distribution. 


Note  that  the  ranges  in  the  above  result  may  also  have  the  form  {0,  1 

Example  2.2 

© 

k  Suppose  that  N  ~  G0(p )  and  that  {Xt:i  =  1,2, ...}  is  a  set  of  independent  random 

variables  each  having  a  Bernoulli  distribution  with  parameter  6.  Find  the  In  this  example,  the  range  of  each 

distribution  of  Z  =  Xx  +  ...  +  XN.  Xt  is  {0, 1}. 

Solution 

II*(s)  =  1  —  9  -f  0s  and  IIN(s)  =  — - — ,  from  Table  2.1. 

1  —  ps 

So 

nz(s)  =  - - q  using  Result  (2.10), 

1  -pUx{s) 

_ _ q _ 

1  -  p(l  -  6  +  6s) 

= _ q _ 

1  —  p(l  —  9)  —  p6s * 
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By  comparison  with  Table  2.1,  this  is  similar  to  the  p.g.f.  for  a  geometric 
distribution  with  range  {0,  1, ...},  but  the  denominator  is  not  of  the  form  1  —  ks.  It 
can  be  changed  to  this  form  by  dividing  through  by  1  —  p(l  —  6)  =  q  +  pd.  Then 

q 


H  z(s)  = 


q  -f  pO 


1  - 


pO 


q  +  p6 


1 _ P±- 

q  +  pd 


1  - 


pO 

q  +  p9 


s 


and  so  Z  has  a  geometric 


pO  ) 
q  +  pd) 


distribution. 


□ 


Question  2.6  A  Poisson  process  with  rate  A  runs  for  a  time  t.  Each  event  that 
occurs  has  a  probability  p  of  being  observed  and  recorded,  and  a  probability 
<7=1  —  p  of  being  missed.  Show  that  the  number  Z  of  events  recorded  in  time  t 
has  a  compound  distribution,  and  find  this  distribution.  □ 

In  the  two  examples  considered  so  far,  the  distribution  of  Z,  a  random  sum  of 
random  variables,  has  taken  a  standard  form.  In  many  cases  this  does  not  happen. 
Even  so,  Result  (2.10)  enables  us  to  write  down  the  p.g.f.  of  Z,  and  this  can  be  used 
for  various  purposes  (for  example,  the  calculation  of  moments). 

Question  2.7  For  each  of  the  following  cases,  use  Result  (2.10)  to  write  down  the 
p.g.f.  of  Z  =  Xx  +  X2  +  ...  +  XN. 

(i)  X(  ~  Poisson (p)  and  N  ~  G^p);  (ii)  Xt  ~  B(n,p)  and  N  ~  Poisson(^).  □ 


3  Properties  of  a  branching  process 

The  aim  of  this  section  is  to  find  the  p.g.f.  of  Z„,  the  number  of  offspring  born  in 
the  nth  generation  of  a  branching  process  (in  Subsection  3.1)  and  then  to  use  this 
p.g.f.  to  find  expressions  for  the  mean  and  variance  of  Z„  (in  Subsection  3.2). 

3.1  The  probability  generating  function  of  a  branching  process 

Result  (2.10)  provides  a  way  of  finding  the  p.g.f.  of  a  random  sum  of  random 
variables.  We  apply  this  result  first  to 

z2  =  x  i  +  X2  +  ...  +  XZi, 

the  number  of  offspring  born  in  the  second  generation,  and  then  to  Z„. 

The  number  of  offspring  X  of  any  individual  has  probability  function  p(x).  Let  LI(s) 
denote  the  p.g.f.  of  X.  The  total  number  of  offspring  in  the  nth  generation  is  Z„ 
and  its  p.g.f.  will  be  denoted  by  n„(s).  Since  there  is  just  one  individual  in 
generation  zero,  n0(s)  =  s;  and,  since  Zj  is  the  number  of  offspring  of  this 
individual,  Zx  has  probability  function  p(x)  and  p.g.f.  n(s),  so 

n  As)  =  n(s). 

Now 

z2  =  X  i  +  x2  + ...  +  xZi, 

where  X,  is  the  number  of  offspring  of  the  ith  member  of  the  first  generation;  so 
each  Xt  has  p.g.f.  n(s),  and,  by  assumption,  Xu  X2,..,,XZi  are  independent 
Hence,  by  Result  (2.10), 

u2(s)  =  n1(n(s)). 

But,  as  you  have  just  seen,  Z l  also  has  p.g.f.  n(s).  Therefore,  the  p.g.f.  of  Z2  is 

n2(s)  =  n(n(4  (3.1) 


Equation  (2.1) 


The  suffix  n  in  n„(s)  is  the 
generation  number;  in  Subsection  2.2, 
n*(s)  was  the  p.g.f.  of  the  variate  X. 
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Example  3.1  (Example  1.1  continued) 

If  each  individual  can  have  only  0,  1  or  2  offspring,  with  probabilities  r,  q ,  p 
respectively,  then  the  p.g.f.  of  X  is 

n(s)  =  r  +  qs  +  ps2,  by  Equation  (2.3). 

So  the  p.g.f.  of  Z2  is 

n2(s)  =  Il(n(s)),  by  Formula  (3.1), 

=  r  +  q  n(s)  +  p{U(s))2 
=  r  +  q(r  +  qs  +  ps2)  +  p{r  +  qs  +  ps2)2 

=  r  +  qr  +  pr2  +  ( q 2  +  2pqr)s  +  {pq  +  pg2  +  2p2r)s2  +  2p2gs3  +  pV. 

The  coefficient  of  sx  (x  =  0,  1,  2,  3,  4)  gives  the  probability  that  Z2  =  x,  and  each 
one  is  (of  course)  the  same  as  was  calculated  in  Example  1.1.  □ 

Now  consider  the  variate  Z„,  which  is  the  sum  of  the  number  of  offspring  of  each 
member  of  the  ( n  —  l)th  generation  and  so  can  be  expressed  as 

+  •••  +  TZjil, 

where  Y{  is  the  number  of  offspring  of  the  zth  member  of  the  (n  -  l)th  generation. 
Each  Yt  has  p.g.f.  U(s);  also  Yl9  Y2,...,  YZn_l  are  independent.  There  are  Zn_x 
7 variates  and  Zn.1  has  p.g.f.  Yl^^s).  So  from  Result  (2.10),  we  have 

n  H(s)  =  n  n-^nis)).  (3.2) 

The  p.g.f.  n„(s)  can  also  be  written  in  other  forms. 


Question  3.1  Show  that 

n„(s)  =  n(nn_1(s)),  (3.3) 

by  considering  the  number  of  individuals  in  the  nth  generation  as  the  sum  of  the 
descendants  (in  the  nth  generation)  of  each  member  of  the  first  generation.  □ 


By  replacing  n  by  n  —  1  in  Formula  (3.3),  we  obtain 

nn_x(s)  =  n(n„_2(s)), 

so 

n„(s)  =  n(n(n„_2(s))). 

Continuing  in  this  way,  we  obtain 


n„(s)  =  n(n(. . .  (n(s)) ...)),  n  =  1,2,..., 


(3.4) 


where  there  are  n  Ils  on  the  right-hand  side. 

Formula  (3.4)  gives  us  an  expression  for  the  p.g.f.  of  the  number  of  offspring  in  the 
nth  generation  of  a  branching  process.  By  expanding  this  as  a  series  in  powers  of  s, 
we  can  find  the  probability  function  of  Z„,  at  least  in  piinciple.  In  practice,  this 
method  is  usually  not  very  convenient;  for  example,  if  the  number  of  offspring  has 
a  Poisson  distribution  with  parameter  A,  then  Formula  (3.4)  gives 

n2(s)  =  exp(  — 2[1  -  exp(  — 2[1  -  5])]), 

and  IlJts)  involves  n  nested  exponential  terms.  However,  Formulas  (3.2),  (3.3)  and 
(3.4)  are  important  for  deriving  various  results  about  branching  processes,  as  you 
will  see  in  the  later  sections  of  this  unit. 

There  are  a  few  offspring  distributions,  p(x),  for  which  the  distribution  of  Z„,  the 
number  of  offspring  in  the  nth  generation,  does  have  a  simple  form,  and  this 
subsection  ends  by  discussing  three  of  these. 


Formula  (3.4)  may  be  proved  by  the 
method  of  mathematical  induction. 
Such  details  are  not  our  concern  in 
this  unit.  These  remarks  also  apply 
to  other  formulas  which  we  obtain 
in  this  way. 
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Question  3.2  If  X ,  the  number  of  offspring  of  an  individual,  has  a  Bernoulli 
distribution  with  parameter  p ,  show  that 

n„(s)  =  q  +  pq  +  . . .  +  pn~  lq  +  pns. 

V 

Using  the  facts 

n„(l)  =  1  and  q  =  1  —  p, 

*  express  n„(s)  in  terms  of  p ,  and  hence  identify  the  distribution  of  Z„.  □ 

Question  3.3  Let  n(s)  =  1  —  a(l  —  s)p,  where  0  <  a  <  1  and  0  <  /?  <  1. 

(i)  Show  that  n(s)  is  a  p.g.f.  (You  will  find  the  Binomial  Theorem  useful.) 

(ii)  Derive  the  p.g.f.  n„(s). 

(iii)  Calculate  the  probabilities  P(Z„  =  0),  P(Zn  =  1)  and  P(Zn  =  2).  □ 


Example  3.2  The  geometric  distribution 


In  this  example  the  distribution  of  Z2  is  found  when  Zx  ~  G0(p).  The  p.g.f.  of 
Zl  —  G0(p)  is  Il(s)  =  q/(  1  —  ps),  and  so,  by  Formula  (3.3), 


n2(s) 


q 

1  -  pq/(  1  -  ps) 


q(  i  -  ps) 
i  -  pq-  ps * 

Dividing  through  by  1  —  pq  and  setting  p/(  1  —  pq)  =  6 ,  the  denominator  becomes 
1  —  6s ,  which  is  convenient  for  expansion,  and  we  obtain 

n,(S)  =  toA1  -  pg))  x  (i  -  ps) 

1  —  0S 


=  M1  -psXl  -  0s)- 1 
p 

=  y(l  -  ps)(l  +6s+  e2S2  +  ...  +  exsx  +  ...). 
Multiplying  gives 


So 


and 


q6 


00 


n2(s)  =  ^  l  +  X  s*(0*  —  p6x~l) 


qe 


x=  1 


00 


=  y(!+  Z  S«[0*  -  0*(1  -  M)] ), 


qe 


X=1 


00 


1  +  ^  sx9xpq  ). 


X=1 


substituting  p  =  0(1  —  pq). 


P(Z2  =  0)  =  ^ 
p 


P(Z2  =  x)  = 


For  x  >  1,  the  distribution  of  Z2  behaves  like  a  geometric  distribution,  though  the 
probability  that  Z2  =  0  does  not  conform  to  this  pattern.  The  distribution  of  Z2  is 
sometimes  known  as  a  modified  geometric  distribution.  □ 


3.2  The  mean  and  variance 

The  mean  and  variance  of  Z„,  the  size  of  the  nth  generation  in  a  branching 
process,  can  be  found  using  the  results  just  obtained  for  the  p.g.f.  of  Z„.  Let  the 
mean  and  variance  of  X,  the  number  of  offspring  from  a  single  individual,  be  n 
and  a2  respectively.  Then,  from  Formulas  (2.5b)  and  (2.6b), 

p  =  FI'(l)  and  a2  =  IT'(l)  +  p  -  p2. 
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Let  the  mean  and  variance  of  Zn  be  \in  and  a2  respectively.  Since  X  and  Z:  have 
the  same  distribution, 

and  o\  =  a2. 

For  n  >  1,  it  follows  from  Formulas  (2.5b)  and  (2.6b)  that 
Vn  =  n;(l)  and  a2n=n'f(l  )  + 

Now  from  Formula  (3.2), 

n  Jts)  =  TILTHS)), 

and  differentiating  this  using  the  Chain  Rule,  we  have 

n;(s)  =  n;.1(n(s»n'(5).  (3.5) 

Putting  s  =  1  and  recalling  that  n(l)  =  1,  we  obtain 

n^(i)  =  n;.1(i)n,(i) 

or 

Vn  =  Hn-lH- 

Applying  this  result  with  (n  —  1)  in  place  of  n,  we  have 

Vn-  1  = 

SO 

Vn  =  H2Hn-Z- 

Repeating  this  procedure,  we  obtain 

t^n  =  3 

= 

So,  since  =  /r, 

(3.6) 

This  is  the  result  that  might  have  been  expected  intuitively  (though  intuition  can 
sometimes  lead  one  astray).  If  the  mean  number  of  offspring  of  an  individual  is  /i, 
then  on  average  there  are  \i  individuals  in  the  first  generation,  each  of  these 

produces  an  average  of  //  offspring  giving  an  averagejsf  [i2  individuals  in  the  ,  , 

second  generation,  and  so  on.  In  Example^. 5  ofJJnitl  we  looked  at  a  shdt 

deterministic  model  of  a  simple  branching  processTTor  this  model  the  population 
size  at  the  nth  generation  is  also  fLn. 

It  is  also  possible  to  obtain  Result  (3.6)  using  the  formula  for  expectation  that  was 
derived  in  Unit  2: 

E(X)  =  EY[E(X  |  Y)l  (3.7) 

We  shall  take  the  X  and  Y  in  Formula  (3.7)  to  be  Z„  and  Zn_u  respectively.  The 
conditional  expectation  E(Zn\Zn.1  =  z)  is  the  expected  number  of  offspring  in  the 
nth  generation  when  the  size  of  the  (n  —  l)th  generation  is  known  to  be  z.  Under 
this  condition,  if  the  ith  member  of  the  (n  —  l)th  generation  has  Yt  offspring,  then 

Zn—  Yy  +  . . .  -f  Yz 

and 

E{Zn\Zn_y  =z)  =  E(Yy  +  ...+  Yz) 

=  Z}1. 

Thus, 

E(Zn  \Zn_y)  =  Z„_  j/i. 

Hence,  applying  Formula  (3.7),  we  have 
Vn  =  E(Zn)  =  EZn  _x[E(Zn  |  Zn_y)~\ 

=  EZn-,(Zn-\ti 

=  Hn- 

The  result  =  jj,n  can  then  be  obtained  as  before. 


4-<( 

Formula  (3^5)  of  Unit  2 
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Of  course,  p  =  E(X)  >  0. 


It  is  interesting  to  note  the  behaviour  of  the  mean  as  n  increases: 

!oo  p  >  1 
1  p  =  1 
0  p  <  1. 

This  suggests  that  if  the  process  continues  for  a  long  time,  the  generation  size  will 
-increase  unboundedly  if  p  >  1,  the  process  will  die  out  if  p  <  l  and  it  will  remain 
grouped  near  1  if  p  =  1.  This  is,  in  fact,  a  misrepresentation  of  the  behaviour.  For 
instance,  in  Figure  1.3(iii)  we  looked  at  the  case  p( 0)  =  p(l)  =  0.25,  p( 2)  =  0.5,  for 
which  p  =  1.25,  which  is  greater  than  1.  After  6  generations,  Figure  1.3(iii)  gives 
the  probability  that  the  process  is  already  extinct  to  be  0.462.  So,  although  p  >  1, 
in  nearly  a  half  of  the  cases  this  branching  process  is  extinct  by  the  sixth 
generation,  and  so  its  size  will  not  increase  indefinitely.  In  Section  4  we  shall 
further  investigate  the  behaviour  of  the  process  as  n  ->  oo.  Before  that  we  shall 
calculate  a  formula  for  the  variance,  cr2,  of  the  generation  size.  This  will  give  us 
further  insight  into  the  possible  ways  in  which  the  process  can  develop. 

Since  a2  =  II  "(1)  +  pn  —  pi  and  pn  =  pn ,  it  is  necessary  to  find  II  "(1).  From 
Equation  (3.5), 

n'(s)  =  n;_1(n(s))n,(s), 

and  differentiating  this,  using  the  Product  Rule  and  the  Chain  Rule,  gives 

n;(s)  =  n',_1(n(s))n'(s)n,(s)  +  n'^n^rrts). 

Then,  setting  s  =  1,  we  obtain 

n''(i)  =  n^wirumxi)  +  n^ijiru) 

=  n"_1(l ) fi2  +  n„- tio2  -  n  +  n2),  (3.8) 

since  n  =  IT(1)  and  <x2  =  IT'(l)  +  n~n2. 


Since  fin  =  fin,  we  have  II''(1)  =  a2  —  n"  +  /i2"  and  IT"_  j(l)  =  ct2_  t  —  n"  1  +  //2n  2, 
and  substituting  these  in  Equation  (3.8)  gives 

a2-fin  +  n2n  =  fi2(ff»2-i  -  Ain_1  +  iJ2”"2)  +  A1”  1(<J2  -  n  +  Ai2), 


so  that  ol  =  p2ol_l  +  pn  1cr2. 

Applying  this  result  repeatedly,  replacing  n  with  n  —  1,  n  — 
°2n  =  H2{n2tf-2  +  fj"~2(r2)  +  nn~1a2 
=  n4<r2- 2  +  +  H) 

=  A<V2^n-3  +  Hn~2G2)  +  At"_1ff2(l  +  At) 

=  At6or2-3  +  fin~la2(l  +  At  +  At2) 

=  At8^2-*  +  At"_1<r2(l  +  At  +  At2  +  At3) 


2, . . . ,  n  —  (n  —  2),  leads  to 
[n-  1] 

[tidying  up] 

0-2] 

[tidying  up] 

[n  —  3,  and  tidying  up] 


=  (/r2)1+(n“2V2_(„_2)_1 

+  ju"_1<r2(l  +  At  +  At2  +  ...  +  At"-2)  [n  —  (n  —  2)] 

=  (a t"-1)2<r2  +  nn~'ff2(l  +  n  +  Ai2  +  ...  +  At"-2)- 
But  a\  =  a2,  so 

a2  =  At"  1<x2(l  +  a <  +  /t2  +  ...  +  At"-1). 

This  can  be  written 


F(Z„)  =  <7„2  =  - 

At  VV  -  1 

,  At  ^  1 

At  -  1 

1 

no2  p  =  1. 

(3.9) 


For  At  >  1,  the  variance  increases  with  n  and  so  the  distribution  of  the  number  of 
individuals  in  a  generation  becomes  more  spread  out  as  the  process  continues;  if 
At  <  1,  the  variance  may  increase  for  a  few  generations  but  then  it  rapidly  decreases 
to  zero.  Since  the  mean  and  variance  of  the  generation  size  both  tend  to  zero  as 
the  generation  number  increases  when  At  <  1,  this  suggests  that  the  population  is 
certain  to  become  extinct.  This  is  indeed  what  happens,  as  will  be  shown  in  the 
next  section. 


n(l)  =  1 


* 
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it 

Question  3.4  If  the  number  of  offspring  of  an  individual  has  a  geometric  G0(p) 
distribution,  find  the  mean  and  variance  of  the  number  of  individuals  in  the  nth 
generation.  Calculate  their  values  when  n  =  5  and  p  is  equal  to  (i)  (ii)  i,  (iii)  f.  □ 

The  total  number  of  individuals  in  a  branching  process,  up  to  and  including  those 
born  in  the  nth  generation  and  also  including  the  ancestor  in  generation  zero,  is 
given  by 

7J,  =  l+Z1-fZ2  +  ...  +  Zn. 

The  mean  of  Tn  can  be  calculated  as  follows: 

E(Tn)  =  E(l  +ZX  +  Z2  +  ...  +  ZJ 

=  1  +  E(Zi)  +  E{Z2)  +  ...  +  E(Zn) 

=  l+  /r  +  /z2  +  ...-h/z,,,  using  Result  (3.6).  (3.10) 

Question  3.5  Find  the  expected  number  of  individuals  who  will  ever  exist  in  a 
branching  process  by  finding  lim  E\Tj.  z 


4  The  probability  of  ultimate  extinction 


In  Section  1  we  looked  at  the  distribution  of  the  numbers  of  individuals  after 
several  generations  and  saw  various  patterns  developing.  For  example,  when  the 
p.g.f.  of  the  offspring  distribution  is  II(s)  =  0.5  +  0.25s  +  0.25s2  (see  Example  3.1 
with  r  =  0.5,  q  =  p  =  0.25),  after  six  generations  there  is  a  probability  of  0.924  (see 
Figure  1.3(i))  that  the  process  has  died  out  completely,  and  a  probability  of  only 
0.014  that  generation  six  contains  more  than  three  individuals.  On  the  other  hand, 
for  the  situation  depicted  in  Figure  1.4(H),  for  which  II(s)  =  0.2(1  +  s  +  s2  +  s3  +  s4). 
there  is  (by  calculation)  a  probability  of  only  0.272  that  the  process  is  extinct  after 
four  generations,  and  a  probability  of  0.345  that  it  contains  over  20  individuals.  In 
this  section  we  shall  investigate  in  more  detail  the  probability  that  the  process  dies 
out  and  so  eventually  contains  no  individuals.  This  is  the  problem  that  was 
originally  discussed  by  Galton  and  Watson  when  they  considered  the  ‘probability 
of  extinction  of  families’. 

For  a  branching  process  to  have  a  possibility  of  becoming  extinct,  there  must  be  a 
non-zero  probability  that  an  individual  has  no  olfspring,  so  it  will  be  assumed 
that  P(X  =  0)  =  p( 0)  >  0.  Since  the  p.g.f.  of  X,  the  number  of  offspring,  is 

oo 

n(s)  =  Y,  P(x)  sX’  ^  follows  that 

jc  =  0 

p(0)  =  n(0)  >  o. 

Let  the  probability  that  the  process  is  extinct  by  the  nth  generation  be  0„;  that  is, 

6n  is  the  probability  that  the  nth  generation  contains  zero  individuals — extinction  6n  =  P(Zn  =  0) 

may  have  occurred  at  the  first,  second  or  any  generation  up  to  and  including  the 
nth.  Once  a  branching  process  becomes  extinct,  it  remains  so  for  all  future 
generations  as  no  more  offspring  can  ever  be  born. 

Since  the  size  of  the  nth  generation  has  p.g.f.  n„(s), 

en  =  p(zn  =  o)  =  nB(0).  (4.i) 

The  probabilities  0X,  02 ,  ...  satisfy  the  inequality 

9i  <  02  <  ...  <  0n- 1  <  0/i  <  ...,  (4.2) 

which  may  be  established  as  follows.  We  have,  for  n  =  1,  2,..., 

^(process  extinct  by  nth  generation) 

=  ^(process  extinct  by  (n  —  l)th  generation) 

+  ^(process  extinct  at  nth  generation), 
so 

^(process  extinct  at  nth  generation)  =  0„  —  0„  _  x 

>0, 

since  this  is  a  probability;  hence,  0n  >  0„_!  and  Inequality  (4.2)  follows. 
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The  values  of  9n  can  be  calculated  using  the  basic  results  for  the  p.g.f.  of  a 
branching  process  that  we  derived  in  Subsection  3.1.  From  Formula  (3.3)  with 
n  =  2,  we  have 

n2(s)  =  n(n(s));  Recall  that  n,  =  n. 

so,  putting  s  =  0  and  using  Equation  (4.1),  we  obtain 

e2  =  n2(0)  =  n(n(0)) 

=  rw 

For  any  value  of  n,  n„(s)  =  n(n„_1(s)),  so 

n„(0)  =  n(n„_1(0)) 

and 

0„  =  n(0„_1).  (4.3) 

This  result  gives  us  an  easy  method  of  calculating  the  probability  of  extinction  at 
any  generation. 


Example  4.1  The  Poisson  distribution 

If  the  number  of  offspring  of  an  individual  has  a  Poisson  distribution  with 
parameter  0.5,  then 

n(s)  =  e-°'5(1"s). 

The  probability  of  extinction  by  the  first  generation,  01;  is  just  the  probability  that 
the  original  ancestor  has  no  offspring: 

0,  =  p(0)  =  n(0)  =  e-°-5  =  0.6065. 

Applying  Formula  (4.3)  gives 

a.-W,)  o  loofcO  -  O  3 

..-0.5(1-0.6065)  V 

&C  JU 

=  0.8214, 

03  =  n(0.8214)  =  0.9146, 

04  =  0.9582, 

05  =  0.9793, 

06  =  0.9897,  etc.  Observe  that  these  values  satisfy 

So,  for  example,  the  probability  that  the  process  is  extinct  by  the  fourth  generation  Inequality  (4.2). 
is  0.9582;  the  probability  that  it  actually  becomes  extinct  at  the  fourth  generation 
is  0.9582  -  0.9146  =  0.0436. 

For  the  Poisson(0.5)  distribution,  the  probability  of  extinction  is  already  very  close 
to  1  by  the  sixth  generation;  if  the  calculations  are  continued  a  little,  then  we 
obtain  01O  =  0.9994,  and  one  might  guess  that  the  process  is  certain  to  become 
extinct  eventually.  □ 


q  My  &  -  t>.  / 

O-IQMsr  ^  Q'%SLl 


Question  4.1  Suppose  that  the  number  of  offspring  has  a  Go(0.6)  distribution. 

(i)  Calculate  06. 

(ii)  Calculate  the  probability  that  the  process  becomes  extinct  at  the  sixth 
generation. 

(iii)  Do  you  think  it  likely  that  ultimate  extinction  is  certain?  □ 


In  the  last  question  it  was  not  obvious  whether  or  not  the  process  would 
ultimately  become  extinct  with  probability  1,  and  we  shall  now  investigate  what 
happens  to  9n  as  n  ->  oo. 

Since  <  9n  for  all  n  and  0  <  9n  <  1  because  it  is  a  probability,  the  sequence 
{0„}  is  increasing  and  bounded  above  by  1.  It  can  therefore  be  proved  that 
lim  0n  =  9*  exists  and  that  9*  <  1.  However,  the  proof  is  irrelevant  to  this  unit, 

n~*  oo 

and  the  behaviour  of  lim  9n  will  be  demonstrated  graphically. 


This  is  an  application  of  the 
Monotone  Convergence  Theorem, 
given  in  the  Handbook. 
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Letting  n  ->  oo  in  Formula  (4.3)  gives 

=  @n-i  )»  This  follows  from  a  result  from 

/  Analysis  given  in  the  Handbook, 

so  if  lim  6n  —  0*  exists,  then  0*  satisfies  the  equation 

n-*  oo 

e  =  n(0).  (4.4) 

This  equation  has  solutions  at  the  points  of  intersection  of  the  graphs  of  y  =  9  and 
y  =  n(0),  and  since  0*  is  the  probability  of  ultimate  extinction,  the  only  solutions 
of  interest  to  Equation  (4.4)  must  satisfy  0  <  0  <  1. 

We  now  obtain  the  graph  of  y  =  11(0)  for  0  <  9  <  1.  We  have 

y  =  n(0)=  £  p(x)e\ 

x  =  0 


When  0  =  0,  we  have  y  -  p{ 0)  =  01(  and  when  0  =  1,  we  have  y  =  £  p(x)  =  1, 

jc  =  0 

since  this  is  the  sum  of  the  terms  of  the  probability  function.  So  the  graph  passes 
through  the  points  (0,0!)  and  (1, 1).  Its  gradient  is  given  by 

%=  E  xp[x)9x-\ 

uu  x  =  0 

and  since  each  p{x)  >  0,  this  sum  is  always  positive  for  9  >  0;  so  the  graph  is 
increasing.  Its  second  derivative  is  given  by 

v  00 

— 2  =  £  X(X  -  l)p(x)0*“2, 
au  x=q 

and  again  this  sum  is  always  positive  for  9  >  0  (unless  p( 0)  +  p(l)  =  1),  so  it  follows 
that  the  gradient  is  also  increasing.  So  the  graph  of  the  function  y  =  11(0)  takes  the 
form  shown  in  Figure  4.1. 


The  graph  of  y  =  0  is  the  straight  line  through  the  origin  which  also  passes 
through  the  point  (1, 1),  and  so  the  two  curves  always  intersect  at  this  point.  There 
are  three  possibilities,  which  are  shown  in  Figure  4.2  (a),  (b)  and  (c).  The  gradient 
of  n(0)  at  0  =  1  can  be  less  than  1  as  in  Figure  4.2(a),  in  which  case  0  =  1  is  the 
only  point  of  intersection  in  the  interval  [0, 1].  The  gradient  can  be  greater  than  1 
as  in  Figure  4.2(b),  in  which  case  there  are  two  points  of  intersection,  one  at  0  =  1 
and  one  at  a  value  of  0  which  is  less  than  1.  In  Figure  4.2(c)  the  gradient  of  11(0)  is 
equal  to  1  at  0  =  1,  so  the  two  curves  touch  here  and  this  is  the  only  solution  of 

0  =  n(0). 


Another  Analysis  result  is  used  here. 

Since  p  is  a  probability  function,  the 
possibility  that  each  p(x)  is  0  cannot 
arise. 


For  the  Bernoulli  distribution, 
y  =  n(0)  =  q  +  pQ  is  a  straight  line: 
dy/d6  =  p  >  0;  d2y/d62  =  0. 
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The  next  step  is  to  see  where  the  points  Q1,  02,  ...  can  be  found  on  the  graphs. 
Figure  4.3  shows  the  graphs  of  y  =  11(6)  and  y  =  0  as  far  as  their  first  point  of 
intersection  in  the  interval  (0, 1].  The  graph  y  =  11(0)  cuts  the  y-axis  at  (0,0^,  since 
0!  =  FMO)  =  n(0),  and  by  referring  to  the  line  y  =  9,  the  point  (0l5O)  can  be 
marked  off  on  the  0-axis.  If  the  vertical  line  through  (0l5O)  is  now  extended  to  the 
curve  y  =  11(0),  then  the  y-coordinate  at  this  point  is  equal  to  11(0!)  =  02  by 
Formula  (4.3).  In  Figure  4.4  this  process  is  continued.  The  horizontal  line  through 
(O,02)  referred  to  the  graph  y  =  0  gives  the  point  (02,O)  on  the  0-axis.  The  next 
point  on  the  y-axis  is  at  II(02)  =  03  and  this  procedure  continues,  generating  the 
sequence  01;  02, ...  on  each  axis. 


0,  0  0,  0,  0,04  0*  0 


Figure  4.3  Figure  4.4 

Since  the  two  curves  always  intersect  at  least  once  in  the  interval  [0, 1],  it  is 
apparent  that  the  sequence  will  always  tend  to  a  limit  0*  and  that  0*  is  the 
smallest  solution  of  the  equation  0  =  11(0)  in  the  interval  [0, 1], 

The  final  step  is  to  relate  the  smallest  solution  of  0  =  11(0)  to  the  three  possibilities 
shown  in  Figure  4.2.  You  saw  that  the  different  cases  arose  from  differences  in 
gradient  of  11(0)  at  0  =  1;  but  this  gradient  is  IT(1),  which  is  the  value  of  the  mean, 

H,  of  the  distribution  of  the  number  of  offspring  of  each  individual.  In  case  (a), 
fi  <  1  and  the  smallest  positive  solution  of  0  =  11(0)  is  9*  =  1.  So  extinction 
occurs  with  probability  1  or,  in  other  words,  extinction  is  certain.  You  saw  in 
Subsection  3.2  that  the  mean  number  of  offspring  at  the  nth  generation  is  fin  and 
that  when  (i  <  1,  /i"  -+  0  as  n  ->  co.  The  result  is  intuitively  sensible,  for  if  each 
individual  produces  fewer  than  one  offspring  on  the  average,  then  the  population  is 
not  maintaining  itself  and  will  tend  to  die  out. 

In  case  (b),  when  n>  1,  the  lowest  point  of  intersection  of  the  graphs  occurs  at  a 
point  where  0*  <  1,  so  the  probability  of  ultimate  extinction  is  less  than  one.  The 
population  may  become  extinct  but  it  may  continue  indefinitely.  The  mean  size  of 
the  nth  generation  is  pi",  which  tends  to  infinity  as  n  tends  to  infinity.  So  if 
extinction  does  not  occur,  the  size  will  ultimately  increase  without  bound.  You  saw 
examples  of  this  behaviour  in  Subsection  1.2  and  also  on  Band  B  of  the  video¬ 
cassette. 

Finally,  in  case  (c),  when  /r  =  I,  the  only  point  of  contact  of  the  graphs  occurs  at 
0*  =  1;  so  in  this  case,  as  in  case  (a),  extinction  occurs  with  probability  1.  Since  the 

mean  size  of  the  nth  generation  is  1  and  its  variance  is  no2,  this  branching  process  This  follows  from  Equations  (3.6) 
may  well  continue  for  a  long  time  before  extinction  finally  occurs.  and  (3.9). 

The  results  of  this  section  are  summarized  below. 

The  probability  of  ultimate  extinction  of  a  branching  process  is  given  by  the 
smallest  positive  solution  9*  of  the  equation  0  =  11(0). 

(i)  If  n  <  1,  then  0*  =  1  and  ultimate  extinction  is  certain. 

(ii)  If  fj,  >  1,  then  9*  <  1  and  ultimate  extinction  is  not  certain. 

This  section  ends  with  some  examples  of  these  results. 
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Example  4.2 

If  an  individual  can  have  only  0,  1  or  2  offspring,  then  the  p.g.f.  of  the  distribution 
is 

II(s)  =  r  +  qs  +  ps2,  where  p  +  q  +  r  =  1. 

(This  situation  was  first  considered  in  Example  1.1.) 

The  equation  0  =  11(0)  is 
6  =  r  +  q6  +  p02 
or 

p92  -  (1  -  q)0  +  r  =  0. 

Substituting  q  =  1  —  p  —  r,  we  obtain 
p02  -  (p  +  r)9  +  r  =  0;  - 

hence, 

(pO  ~  r)(0  -  1)  =  0. 

So  the  solutions  of  the  equation  are  0  =  r  p  and  0  =  1.  If  r  >  p,  then  the  smallest 

solution  is  0*  =  1  and  extinction  is  certain.  If  r  <  p,  then  extinction  will  occur  with 
probability  r/p.  The  mean  p  is  given  by 

p  =  IT(1)  =  q  +  2p 

=  P  +  (p  +  q) 

=  p  +  1  —  r. 

So:  p  >  1  when  p  —  r  >  0,  in  which  case  extinction  is  not  certain; 
p  =  1  when  p  =  r,  in  which  case  extinction  is  certain; 
p  <  1  when  p  —  r  <  0,  in  which  case  extinction  is  certain. 

It  is  interesting  to  interpret  some  of  the  numerical  calculations  in  Example  1.1  in 
the  light  of  the  results  just  obtained.  When  r  =  0.5,  q  =  0.25,  p  =  0.25,  we  have 
p  =  0.75  <  1  so  extinction  is  certain.  The  probability  that  extinction  had  occurred 
by  the  sixth  generation  was  found  to  be  0.924  and  the  probability  that  there  were 
more  than  three  individuals  in  the  sixth  generation  was  only  0.014.  So  extinction 
has  usually  occurred  by  this  time.  When  r  =  0.1,  q  =  0.1,  p  =  0.8,  we  have  p  =  1.7 
and  the  probability  of  ultimate  extinction  is  r/p  =  0.125.  The  probability  that 
extinction  had  occurred  by  the  sixth  generation  was  found  to  be  0.1249,  and  so  if 
extinction  is  going  to  occur,  it  has  almost  certainly  done  so  by  the  sixth 
generation.  In  fact,  as  you  can  check,  03  =  0.123;  so  if  extinction  occurs,  it  is  very 
likely  to  occur  by  the  third  generation.  □ 

Question  4.2  Suppose  that  the  number  of  offspring  has  a  G0(p)  distribution. 

(i)  Calculate  the  probability  of  ultimate  extinction  of  the  branching  process. 

(ii)  Verify  that  your  solution  agrees  with  results  (i)  and  (ii)  in  the  box. 

(iii)  If  p  =  0.6,  compare  your  answer  with  Solution  4.1.  □ 

Solving  the  equation  6  =  11(0)  is  sometimes  made  easier  by  remembering  that 
0  =  1  is  always  one  solution,  a  point  which  you  will  use  in  the  next  question. 

Question  4.3  Suppose  that  the  number  of  offspring  has  a  B(3,p)  distribution. 

(i)  Show  that  the  equation  0  =  11(0)  may  be  written  in  the  form 

p303  +  3 qp202  -  (p3  +  3 qp2  +  q3)0  +  q3  =  0. 

(ii)  Using  the  fact  that  0=1  is  a  solution  of  the  above  equation,  find  the  quadratic 
equation  satisfied  by  0*  when  p  > 

(iii)  Find  the  probability  of  ultimate  extinction  when  p  =  □ 

In  some  cases,  the  equation  0  =  11(0)  cannot  be  solved  explicitly  and  an  iterative 
method  is  required.  The  simplest  iterative  procedure  is  to  use  Formula  (4.3)  and 
calculate  the  sequence  01?  02,...  as  in  Example  4.1  and  Question  4.1.  This 
sequence  always  tends  to  0*,  but  the  convergence  is  sometimes  quite  slow  and  the 

Newton-Raphson  method  converges  faster.  Of  course,  if  IT(1)  <  1,  then  extinction 
is  certain  and  0*  =  1. 


Figure  1.3(i) 


In  Figure  1.3(iv),  the  value  0.1249 
was  rounded  to  0.125. 
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Example  4.3  The  Poisson  distribution 


To  find  the  probability  of  extinction  of  a  branching  process  when  the  offspring 
distribution  is  Poisson(/i),  it  is  necessary  to  solve  the  equation 
0  =  <?-*!-•>. 

As  a  particular  example,  consider  \x=  1.5.  Proceeding  as  in  Example  4.1,  taking 
*  0„  =  e~ 1,5(1  leads  to  the  sequence 


0l  =  0.223,  05  =  0.395, 

02  =  O.312,  06  =  0.404, 

03  =  0.356,  07  =  0.409, 

04  =  O.381,  08  =  O.412, 


09  =0.414, 
0io  =  O.415, 
0U  =  0.416, 
012  =  0.416. 


However,  if  five  decimal  places  are  carried,  we  find  0*  =  0.417: 


11 

=  0.415  82, 

016 

=  0.41706, 

12 

=  0.41633, 

017 

=  0.417 

11, 

13 

=  0.41665, 

$18 

=  0.417 

14, 

14 

=  0.41685, 

019 

=  0.417 

16, 

15 

=  0.41698, 

^20 

=  0.417 

17. 

So  0*  =  0.417  to  three  decimal  places. 


Using  the  Newton-Raphson  method,  we  write 
g(x)  =  e~ 1,5(1  ~x)  —  x; 

then 

g'(x)  =  1.5e“ 1,5(1  —  1 

and  the  iteration  formula  is 


x  is  used  here,  rather  than  0,  to 
emphasize  that  a  different  method  is 
being  used. 


g—1.5(l  -x„)  _ 

x"+1  =X"“  i.5e- i-sa -*.)_Y 

Possible  starting  points  are  x0  =  0  or  x0  =  #i  =  e~15.  With  the  latter,  we  obtain 


x0  =  0:223, 

x4  =  0.414, 

Xb  -  o.  2  2b 

y5  - 

6  •  9 

x,  =  0.352, 
x2  =  0.394, 
x3  =  0.409, 

x5  =  0.416, 
x6  =  0.417, 
x7  =  0.417. 

V  -  O- 
7  i 

Y4  = 

o  -4  /  $9 

This  method  converges  much  more 

rapidly  to  0*  =  0.417.  □ 

Question  4.4  Suppose  that  the  offspring  distribution  is  discrete  uniform,  with 
P{X  =  x)  =  0.2,  x  =  0,  1,  2,  3,  4. 

Calculate  the  probability  of  ultimate  extinction  of  the  branching  process.  □ 


5  Extensions  to  the  Galton-Watson  model 


In  the  first  four  sections  of  this  unit,  we  have  investigated  many  properties  of  the 
Galton-Watson  model.  In  this  section,  some  ways  in  which  the  model  can  be 
extended  will  be  described,  and  the  unit  ends  with  descriptions  of  some  other 
models  for  branching  processes. 


5.1  A  branching  process  with  more  than  one  ancestor 

In  the  basic  model  it  is  assumed  that  the  process  starts  with  one  individual  in 
generation  zero,  so  Z0  is  equal  to  one.  We  shall  now  assume  that  there  is  a  fixed 
number,  /c,  of  individuals  in  generation  zero,  but  otherwise  the  model  behaves 
exactly  as  before.  By  the  independence  assumptions  of  the  model,  each  of  these  k 
individuals  will  give  rise  to  a  separate  branching  process,  which  will  develop, 
independently  of  the  other  (k  —  1),  along  the  lines  already  described. 
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Let  Zn  i  denote  the  number  of  individuals  in  the  nth  generation  descended  from  the 
fth  individual  in  generation  zero  (i  =  1,  2,...,/c),  and  let  Sn  denote  the  total  number 
of  individuals  in  the  nth  generation.  Thus, 

=  Zn,i  +  Z„,2  +  ...  +  Z„  (n  =  1,2,...). 

Since  Zw>1,  Z„>2,  ...,  Z„>fc  are  independent  and  identically  distributed,  each  with 
p.g.f.  ITn(s),  and  since  k  is  fixed,  the  p.g.f.  of  Sn  is  given  by  Result  (2.8): 

USn(s)  =  (nn(s))\ 

Question  5.1  Given  k  ancestors  in  generation  zero,  write  down  the  mean  and 
variance  of  the  number  of  individuals  in  the  nth  generation,  in  terms  of  fi  and  a2, 
the  mean  and  variance  of  the  number  of  offspring  of  each  individual.  □ 

You  have  seen  in  Section  4  that  if  n  <  1,  then  the  ultimate  extinction  of  a  single¬ 
ancestor  process  is  certain  to  occur.  So  in  this  case,  however  large  k  is,  each 
separate  process  will  eventually  become  extinct  with  probability  1  and  so  the 
whole  process  will  die  out.  If  \i  >  1,  then  9 *  the  probability  that  any  process 
becomes  extinct,  is  less  than  one.  With  k  ancestors,  total  extinction  occurs  if  and 
only  if  each  separate  process  becomes  extinct,  and  this  event  has  probability  ( 6*)k . 
The  process  does  not  become  extinct  if  at  least  one  of  the  k  separate  processes 
does  not  become  extinct,  but  increases  without  bound.  The  probability  of  this  is 
1  —  (0*)k,  which  is  very  close  to  1  when  k  is  large,  even  if  9*  is  only  just  less  than  1. 

One  example  of  a  situation  where  this  result  is  important  is  in  a  nuclear  chain 
reaction  which  starts  with  many  neutrons.  If  \i  <  1,  then  the  reaction  is  certain  to 
die  away,  but  provided  fi  >  1  extinction  is  very  unlikely  and  so  the  population  size 
almost  certainly  increases  without  bound  and  a  nuclear  explosion  takes  place. 

Another  situation  in  which  this  result  can  be  applied  is  the  original  problem 
considered  by  Galton  and  Watson — that  of  extinction  of  family  surnames.  In  1939, 
A.  J.  Lotka  published  some  data  on  the  distribution  of  the  number  of  male 
children  born  to  men  in  the  USA  at  the  time.  He  found  that  a  modified  geometric 
distribution  fitted  the  data  well — that  is,  for  men  who  had  sons,  the  number  had  a 
geometric  distribution,  but  there  were  comparatively  more  men  with  no  sons.  The 
distribution  was  found  to  have  a  mean  of  1.26  and  the  probability  of  extinction  of 
descendants  from  a  single  individual  was  calculated  to  be  0.82.  So  the  name  of  any 
particular  family  has  a  high  probability  of  dying  out.  However,  if  there  were 
(for  example)  40  men  with  the  same  surname,  the  probability  of  that  name  dying 
out  would  be  only  0.8240  =  0.0004.  With  a  common  surname,  like  Smith,  the 
probability  of  ultimate  extinction  is  negligible. 


5.2  A  branching  process  with  immigration 


Another  possible  extension  to  the  Galton-Watson  model  occurs  when  at  each 
generation  there  is  a  possibility  that  one  or  more  individuals  join  the  population 
from  outside  and  then  start  to  reproduce  in  the  same  way  as  individuals  already  in 
the  population.  This  situation  is  technically  known  in  stochastic  processes  as 
immigration;  you  will  meet  it  again  in  later  units.  It  is,  of  course,  the  situation  that 
occurs  with  a  human  population  in  a  town  or  country  where  immigration  is  taking 
place. 


This  means  that  each  immigrant 
reproduces  independently  of  other 
immigrants  and  of  the  members  of 
the  generation  joined,  according  to 
the  common  offspring  distribution. 


Suppose  that  the  branching  process  has  the  basic  model  as  described  in  Subsection 
1.2,  starting  with  one  ancestor  in  generation  zero,  and  that  at  each  subsequent 
generation  immigrants  may  arrive.  Let  the  number  of  immigrants  arriving  at  any 
generation  have  p.g.f.  T^s).  To  distinguish  this  model  with  immigration  from  the 
standard  model,  let  {Z*;n  =  0, 1,...}  denote  the  random  process  for  the  size  of  the 
nth  generation  and  n?(s)  denote  the  p.g.f.  of  Z*.  So  Z%  =  1  and 

Zf=W1+Z1, 

where  W1  is  the  number  of  immigrants  arriving  at  the  first  generation  (p.g.f.  'F(s)) 
and  Z  x  is  the  number  of  offspring  of  the  original  ancestor  (p.g.f.  n(s)).  Hence,  since 
Wx  and  Zx  are  independent,  it  follows  from  Result  (2.7)  that 

nf(s)  =  '¥(s)Tl(s).  '  (5.1) 
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Similarly,  Z\  —  W2  +  Z 2,  where  W2  is  the  number  of  immigrants  arriving  at  the 
second  generation  and  Z2  is  the  total  number  of  offspring  of  the  Z\  individuals  of 
the  first  generation.  The  p.g.f.  of  W2  is  ^(s);  since  Z2,  the  total  number  of  the 
offspring  of  the  Z*  members  of  the  first  generation,  is  a  compound  distribution,  its 
p.g.f.  is,  by  Result  (2.10), 

n  Zl(s)  =  n?(n(s)). 

Hence, 

nt(s)  =  T'(s)n*(n(s)) 

=  V(s)  v(n(s))n(n(s)), 

substituting  for  n}c(n(s))  from  Equation  (5.1). 

In  fact,  for  Z*  =  Wn  +  Zn,  where  Wn  is  the  number  of  immigrants  joining  the  nth 
generation,  we  have 

n*(s)  =  *¥(s)  n*_  x(n(s)),  n  =  1, 2, . . .  .  (5.2) 

Question  5.2  Find  the  expression  for  n*(s)  in  terms  of  ^(s)  and  H(s)  only.  □ 

Question  5.3  Suppose  that  there  is  exactly  one  immigrant  per  generation.  Use 
Solution  5.2  to  write  down  expressions  for  n?(s),  nf  (s), . . . ,  n*(s)  in  terms  of  s  and 
n  only.  Interpret  the  different  terms  of  the  expression  for  n*(s).  □ 

Question  5.4  Suppose  that  the  mean  number  of  offspring  per  individual  is  jj,  and 
the  mean  number  of  immigrants  per  generation  is  v. 

(i)  Differentiate  Formula  (5.2)  to  obtain  an  expression  for  p*,  the  mean  number  of 
individuals  in  the  nth  generation,  in  terms  of  /i*_  x.  (Hint:  Recall  that  the  value 
of  any  p.g.f.  at  1  is  1.) 

(ii)  Hence,  calculate  p*  in  terms  of  p  and  v.  □ 

Example  5.1 

Suppose  that  the  number  of  offspring,  X ,  has  a  Bernoulli  distribution,  and  the 
number  of  immigrants,  Wn,  has  a  Poisson  distribution.  Derive  the  p.g.f.  of  the  size 
of  the  nth  generation,  n*(s),  and  investigate  its  behaviour  as  n  tends  to  infinity. 

Solution 

Since  X  ~  B(l,p)  and  Wn  ~  Poisson(/z),  n  =  1,2,...,  we  have 
n(s)  =  q  -f  ps  and  ^(s)  =  e~^{1  ~s); 
so,  from  Result  (5.2), 

n*(s)  =  e~^l~s)(q  +  ps) 

and 

n2*(s)  =  v(s)m(m) 

=  *(q  +  ps) 

=  e~^{1~s)(q  +  p{q  4-  psj)e~,l{1~q~ps). 

This  can  be  simplified  by  substituting  q  =  1  —  p  to  give 
n*(s)  =  e-M(1-5)(l  —  p  +  p(l  —  p)  -f  p2s)e~tl(p~ps) 

_  g-Md+pXl-s^J  —  p2  +  p2sy 

Similarly,  applying  Result  (5.2)  with  n  =  3,  we  obtain 
Ut(s)  =  ^(s)Ut(U(s)) 

=  g-rti-.)e-na+FXi -€-!»)(!  -  p2  +  p2(q  +  ps)) 

—  e~p{l~s)(i+p+p2\\  —  p3  -f  p3s),  since  q  =  1  —  p. 

The  general  form  is  now  emerging,  and  it  turns  out  that 
U*(s)  =  e-^i-sxi  +p+..  +p--1)(1  _  pn  +  pnsy 


(5.3) 


In  order  to  investigate  the  limiting  behaviour  of  II*(s),  it  is  convenient  to  rearrange 
the  expression  a  little: 

1  +  p  +  ...  +  p""1  =  (1  -  p")/(l  -  p) 

=  (1  -  Pn)/q. 

So 


n*(s)  =  e-Mi-s)(i-p")/«(i  -  P"  +  p"s). 

Since  0  <  p  <  1,  it  follows  that  lim  p"  =  0.  Hence,  n^(s)  -»■  n*(s)  as  n  ->  oo,  where 

rt~*  co 

n*(s)  =  g-tfi -*>/«, 

and  this  is  the  p.g.f.  of  a  Poisson  distribution  with  parameter  ixjq.  □ 

The  existence  of  a  limiting  distribution  for  the  size  of  a  generation  is  a  behaviour 
pattern  different  from  those  we  have  met  previously  in  this  unit.  Without 
immigration,  the  only  possible  way  in  which  the  branching  process  can  develop  is 
either  to  become  extinct  or  to  increase  unboundedly.  But  with  immigration  there  is 
another  possibility.  Since,  in  this  case,  the  number  of  offspring  has  a  Bernoulli 
distribution  (mean/?  <  1),  the  process  initiated  by  any  individual  is  certain  to 
become  extinct  eventually.  But  immigrants  may  arrive  at  each  generation,  and 
each  immigrant  starts  up  a  new  branching  process.  So  we  reach  a  situation  where, 
after  a  large  number  of  generations,  the  generation  size  has  a  Poisson (fi/q) 
distribution.  This  type  of  behaviour  will  occur  whenever  the  mean  number  of 
offspring  is  less  than  1.  If  this  mean  is  greater  than  1,  the  size  of  a  generation  will 
eventually  increase  unboundedly.  You  will  meet  the  same  sort  of  behaviour  in 
Unit  8  when  a  birth  and  death  process  with  immigration  is  studied. 


Various  results  concerning  limits  of 
convergent  sequences  are  required  to 
show  that  IT*(s)  ->  n*(s)  as  n  oo. 
(For  example, 

lim(an  +  bn)  =  lim  an  +  lim  bn ; 

this  and  the  other  results  are  stated 
in  the  Handbook.)  Do  not  concern 
yourself  with  these  details;  the 
important  point  of  this  example  is 
the  existence  of  a  limiting 
distribution. 


5.3  Other  models  of  branching  processes 

In  this  unit  we  have  made  a  study  of  the  Galton-Watson  branching  process,  and 
in  this  section  we  have  seen  two  extensions  to  this  model.  There  are  many  other 
models  for  branching  processes  that  we  shall  not  study  in  this  course.  The  most 
important  group  of  models  consists  of  continuous-time  ones.  Instead  of  a  fixed 
generation  time,  offspring  can  be  born  at  any  stage.  The  application  to  the  spread 
of  a  rumour  can  be  modelled  in  this  way,  and  it  is  very  relevant  to  the  study  of 
nuclear  or  chemical  chain  reactions  where  the  time  interval  between  branching  is 
critical  to  the  possibility  of  an  explosion.  Another  group  of  models  consists  of 
multitype  branching  processes,  in  which  each  offspring  is  one  of  several  possible 
types  and  each  type  may  have  a  different  reproductive  pattern.  Branching 
processes  are  a  major  topic  of  research  in  applied  probability,  and  they  have 
applications  in  many  different  areas. 
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Objectives 

Y 

After  studying  this  unit  you  should  be  able  to: 

explain  what  is  meant  by  the  Galton-Watson  model  for  a  discrete-time  branching 
process; 

derive  the  probability  generating  function  of  a  discrete  random  variable  with  a 
given  probability  function; 

derive  the  formulas  for  the  mean  and  variance  of  a  distribution  in  terms  of  the 
p.g.f.,  and  apply  the  formulas  to  specific  distributions; 

show  that  the  p.g.f.  of  a  random  sum  of  N  random  variables,  each  with  p.g.f.  Ux(s ), 
is  nN(Il*(s)),  and  apply  this  formula  to  specific  distributions; 

derive  the  p.g.f.  of  the  size  of  the  nth  generation  in  a  branching  process,  and  apply 
this  result  to  specific  distributions; 

derive  formulas  for  the  mean,  and  variance,  of  the  size  of  the  nth 
generation,  and  calculate  them  for  specific  cases; 

calculate  the  probability  that  a  branching  process  is  extinct  by  the  nth  generation; 

derive  the  equation  9  =  TT(0)  satisfied  by  the  probability  of  extinction; 

show,  with  the  help  of  graphs,  that  the  smallest  root,  0 *,  of  0  =  11(0)  is  9*  =  1 
when  n  <  1  and  is  9*  <  1  when  fj.  >  1; 

calculate  the  probability  of  extinction  of  a  specific  simple  branching  process; 

show  how  the  main  results  derived  from  the  Galton-Watson  model  for  a 
branching  process  are  modified  when  the  process  starts  with  k  individuals,  and  use 
these  results; 

show  how  the  main  results  derived  from  the  Galton-Watson  model  for  a 
branching  process  are  modified  when  immigration  may  occur  at  each  generation, 
and  use  these  results. 
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Appendix:  Solutions  to  questions 


Section  1 


Section  2 


1.1  In  outcome  (i),  the  ancestor  has  no  offspring  so  the 
probability  is  r.  (In  this  case  Zx  =  Z2  =  0.) 

In  outcome  (ix),  the  ancestor  has  2  offspring  (the  probability 
of  which  is  p).  Then  one  of  these  has  2  offspring  ( p ),  and  the 
other  has  no  offspring  (r).  The  probability  of  outcome  (ix) 
is  p2r. 


Similarly,  the  probability  of  outcome  (xi)  is  p2q. 

1.2  If  Z2  =  0,  then  Z3  must  also  equal  0.  If  Z2  =  x 
(x  =  1,  2,  3,  4),  then  each  of  these  x  individuals  must  have  no 
offspring,  which  has  a  probability  of  r*.  Hence,  using  the 
probability  function  of  Z2, 

P(Z3  =  0)  =  r  +  qr  +  pr2  +  r(q2  +  2 pqr) 

+  r2(pq  +  pq2  +  2  p2r)  +  r3(2p2q)  +  r4p\ 
which  can  be  written 

P(Z3  =  0)  =  r(l  +  q  +  q2)  +  pr2(  1  +3 q  ~  q~) 

+  2p2r3(l  +  q)  +  p3r4. 

1-3(0  The  diagram  shows  all  possible  outcomes  with 
Z2  =  2. 


p(0)p:(l)p(3)  p:(0)p(2)p(3) 


(ii)  The  probability  of  each  possible  outcome  is  written  in 
the  diagram.  Adding  these,  we  obtain 

P(Z2  =  2)  =  p{  1 )  p(2)  +  p2(l)p(2)  +  2p(0)p2(2) 

T  3  p(0)p2(l)p(3)  +  3  p2(0)  p(2)  p(3). 


2.1  For  the  Poisson  distribution, 
e~tiux 

P{x)  =  —7-,  x  =  0,1,2,.... 


x! 


Hence, 


n<s)  =  X 


x  =  0 


X! 


i 


(A'v)’ 


x  =  0 

=  e~fIe^ls 


rn  x! 


_  -  s) 

c  j 

and  this  is  the  p.g.f.  of  the  Poisson  distribution. 


2.2  Since  Y  =  aX  +  b,  its  p.g.f.  is  given  by 
n Y(s)  =  E(sY),  by  Equation  (2.2), 

=  E(saX+b) 

=  E(saXsb) 

=  s*£[(sfl)*] 

=  s*n^(sa),  as  required. 


2.3  For  the  geometric  distribution  G0(p), 


n  (s)  = 


q 


so 


n'(s)  = 


and 


1  —  ps' 
PQ 

(1  -  ps)2 

2  P2q 


n  w(s)  = 

(1  -  ps)3 

Prom  Formula  (2.5b),  the  mean  p  is  given  by 
PQ 


P  =  n'(l)  = 


(1  ~  P): 


=  since  p  +  Q  =  1, 

and  from  Formula  (2.6b)  the  variance  a2  is 
2  2p29  p  p2 

ff  =  — —  H - - 

9  9  9 

p2  +  pq 


=  since  p  +  9  =  1. 
9 


2.4  Since  each  —  G^p),  each  has  p.g.f. 
ps/(\  -  qs ); 

so,  by  Result  (2.8),  the  sum  of  n  such  independent  geometric 
variates  has  p.g.f. 

(ps/(l  -  qs))". 

This  is  the  p.g.f.  of  a  negative  binomial  distribution  with 
parameters  (n,  p).  (See  Table  2.1.)  (This  is  an  intuitive  result 
since  the  number  of  Bernoulli  trials  for  n  successes  to  be 
recorded  can  be  thought  of  as  the  sum  of  n  sequences  of 
trials,  each  of  which  contains  a  number  of  failures  and  then 
one  success,  and  so  each  sequence  has  a  geometric 
distribution.) 

* 

2.5  Let  Y  =  Xl  +  ...  +  Xn,  where  Xt  ~  Poisson(/(,).  Then 
nr(s)  =  nXi(s)  rir2(.s) . . .  n^(s),  by  Result  (2.7), 

=  exp(-p,(l  -  s))exp(-p2(l  -  s))...exp(— p„(l  -  s)) 
=  exp(— (p1  +  p2  +  ...  +  MnXl  —  s)). 

This  can  be  recognized  as  the  p.g.f.  of  a  Poisson  distribution 
with  parameter  pt  +  ...  +  pn. 


2.6  Let  the  total  number  of  events  recorded  be  Z.  Then  Z 
can  be  thought  of  as  the  sum  of  N  random  variables, 

Xl  +  ...  +  XN ,  where  N  is  the  total  number  of  events 
occurring  in  time  t ,  and  each  X,  is  equal  to  1  or  0  according 
as  event  i  is  recorded  or  not.  Then: 

Z  has  a  compound  distribution; 

N  ~  Poisson(At),  so  nN(s)  =  e~Xta~s)' 
and 

~  fi(l,p),  so  n x(s)  =  q  +  ps. 

Hence, 

n^s)  =  nw(nx(s)),  by  Result  (2.10), 

_  ^  ~  Xt[  1  -  (q  +  ps)] 

_  g-Af(p-ps) 

_  ^  ~  Apr(  1  -  s) 

Hence,  Z  has  a  Poisson(/pt)  distribution. 

(This  example  was  also  considered  in  Unit  2,  as  an  example 
of  both  a  multivariate  Poisson  process  (with  events  of  two 
types — recorded  and  not  recorded)  and  a  compound  Poisson 
process.) 

p  riv(s)  n$ 

2.7(i)  n2(s)  =  -  ?  ■ -?- -  since  n^s)  =  — ^ — , 

1  -  4  H*(s)  1 

-H(l-s) 

= - 77 — r,  since  nx(s)  =  e  s). 

(ii)  fl^s)  =  exp(-/r[l  -  n*(s)]),  since  nN(s)  = 

=  exp( -/i[l  ~(q  +  ps)"]),  since  nx(s)  =  {q  +  ps)". 

In  both  cases  the  p.g.f.  of  Z  takes  a  fairly  complicated  form. 
(The  probability  function  of  Z  could  be  found  by  expanding 
the  p.g.f.  in  powers  of  s.) 


0 


bi¬ 


section  3 

3.1  The  number  of  individuals  in  the  nth  generation  can 
also  be  thought  of  as  the  sum  of  the  descendants  (in  the  nth 
generation)  of  each  member  of  the  first  generation;  each  of 
these  members  starts  his  own  independent  branching  process. 
So 

Zn  =  Ui  +  -  .  *  +  uZi, 

where  each  U{  is  the  number  of  descendants  after  a  further 
(n  —  1)  generations  of  the  zth  member  of  the  first  generation. 
Each  Ut  has  p.g.f.  n^^s).  There  are  Zx  U  variates  and  Zx 
has  p.g.f.  n(s).  So,  applying  Result  (2.10)  to  the  compound 
distribution  Zn,  we  obtain 

n„(s)  =  n(n„_,(s)). 

3.2  From  Table  2.1,  the  p.g.f.  of  X  is  TI(s)  =  q  +  ps. 
Applying  Formula  (3.2)  repeatedly,  we  obtain 

n2(s)  =  q  +  p(q  +  ps) 

=  q  +  pq  +  p2s, 
n3(s)  =  q  +  pq  +  p2(q  +  ps) 

=  q  +  pq  +  p2q  +  p3s, 

II4(s)  =  q  +  pq  +  p2q  +  p3q  +  p4s,  . 

n„(s)  =  q  +  pq  +  ...  +  p"~lq  +  pns. 

Since  n„(l)  =  1, 

i  =q  +  pq  + ...  +  pn~lq  +  p"; 

SO 

1  —  pn  =  q  +  pq  +  . . .  T  pn~  lq 
and 

n „(s)  =  i  -  pn  +  pns. 

Hence,  Z„  has  a  Bernoulli  distribution,  £(l,pn). 


3.3(i)  To  show  that  n(s)  is  a  p.g.f.,  we  expand  it  as  power 
series  (using  the  Binomial  Theorem)  and  then  show  that  it 
satisfies  the  conditions  given  on  page  10.  We  have 

n(s)  =  1  —  a(l  —  s)p 

~  »,■  +  ~  W-  , 

=  a0  +  axs  +  a2s2  +  ...  . 

To  show  that  this  is  a  p.g.f.,  it  is  necessary  to  show  that  . 

oo 

0  <  ax  <  1  for  X  =  0,  1,  2,...,  and  that  £  ax  =  1. 

x  =  0 

Since  0  <  a  <  1  and  0  <  P  <  1,  it  follows  that  p  -  1  <  0, 

P  —  2  <  0,  ...,  and  hence  each  ax  >  0.  Also,  n(l)  =  1,  so 

OO 

X  ax  =  1,  and  hence  each  ax<  1. 

x  =  0 

So  U(s)  is  a  p.g.f. 

(ii)  Repeated  use  of  Formula  (3.3)  gives: 

n2(s)  =  1  —  a(l  —  [1  —  x(l  —  s)^])^ 

=  1  —  a1  +/*(1  -sY\ 

n3(s)  =  i  -  a(i  -  n 2(S)Y 

=  1  —  a(l  —  [1  -a1+^(l-s/2]/ 

=  1  -a1+^2(l  -sf\ 

n„(s)  =  1  -  a1 +/?  +  .• .+^-1(i  _  sf. 

(iii)  Expanding  the  expression  for  Yln(s)  found  in  part  (ii), 
we  have 

n„(s)  =  1  s  +  y~  ^s2-,..! 

Hence, 

P(Zn  =  0)  =  1  -al+fi+-+r’\ 

P(Zn  =  =  + 

P(Zn  =  2)  =  a1  _  ^)/2 


3.4  From  the  table  in  the  Handbook,  the  distribution  G0(p 

has  mean  p  =  -  and  variance  o2  = 

<1  q2 

Hence,  from  Result  (3.6),  the  mean  size  of  generation  n  is 
(p/q)n  and  from  Equation  (3.9)  its  variance  is 

—  l^j  when  q  ^  p 

when  q  =  p 

(p  -  q)  when  q  #  p 

wrhen  q  =  p. 

(i)  When  n  =  5  and  p  =  we  have  p5  =  (i/f)5  =  0.031 
and  a\  =  3(25  -  l)/210  =  0.091. 

(ii)  When  n  =  5  and  p  =  we  have  p5  =  1  and  a]  =  10. 

(iii)  When  n  =  5  and  p  =  f ,  we  have  p5  =  32  and 
<s\  =  32  x  31/i  =  2976. 


3.5  E(Tn)  —  1  +  p  +  p2  +  . . .  +  pn 
Pn+1  ~  1 

- 7 —  when  p  >  1 

p  -  1 

=  {  n  +  1  when  p  =  1 

1  -pn+1 


1  -p 


when  p  <  1. 


As  n  — ►  oo,  pn+1  -►  oo  when  p  >  1  but  pn  +  1  ->0  when  p  <  1. 
Hence, 

oo  when  p>  1 

lim  E(Tn)  =  {  1 

v  n)  '  -  when  p  <  1. 
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1  -  p 


Section  4 


4.1(i)  For  Go(0.6),  II(s)  =  ^  =  — — -  -  (the  latter  form 

1  —  0.6s  5  —  3s 

being  easier  for  calculation).  Hence,  using  Formula  (4.3), 
we  obtain 


0 1  = 


5-3x0 


=  0.4, 


2  "  5  -  3  x  0.4 
e3  =  0.584, 

04  =  0.616, 

05  =  0.635, 
e6  =  0.646. 


0.526, 


(ii)  The  probability  that  the  process  becomes  extinct  at  the 
sixth  generation  is  0.646  —  0.635  =  0.01 1. 


(iii)  The  sequence  is  increasing  slowly.  Continuing 
the  sequence,  we  obtain  012  =  0.665,  so  if  the  sequence  does 
reach  1  it  will  take  many  generations.  We  cannot  decide 
whether  or  not  the  probability  of  ultimate  extinction  is  one. 


4.2(i)  When  the  number  of  offspring  ~  G0(p),  its  p.g.f.  is 
n(s)  =  q/(  1  —  ps).  Hence,  the  equation  9  =  U(9)  is 


1  —  p0 

or 

p02  —  9  +  q  =  0. 

Hence, 

(p9  —  q)(6  —  1)  =  0,  since  p  4-  q  —  1; 
so  Q  =  1  or  9  =  q/p. 

Thus,  if  p  <  q,  then  the  probability  of  ultimate  extinction  is 
1;  if  p  >  q,  the  probability  of  ultimate  extinction  is  q/p. 

(ii)  The  mean  of  the  offspring  distribution  is  p  =  p/q. 

If  p  <  1,  then  p  <  q  and  the  smaller  solution  of  9  =  n(0)  is 
0*  =  1.  Thus,  ultimate  extinction  is  certain. 

If  p  >  1,  then  p  >  q  and  the  smaller  solution  of  9  =  n(0)  is 
9*  =  q/p ,  the  probability  of  ultimate  extinction. 

(iii)  When  p  =  0.6, 

9*  =  0.4/0.6  =  0.667. 

In  fact,  the  sequence  generated  in  Solution  4.1  converges  to 
this  value. 


4.3(i)  The  p.g.f.  of  X  ~  B{ 3,  p)  is  11(0)  =  (q  +  p0)3.  Thus,  the 
equation  9  =  U(9)  is 

e  =  (q  +  pO)3, 
that  is, 

p303  T  3 qp292  4-  (3 q2p  -  1)0  +  q3  =  0. 

Since  q  +  p  =  1,  we  have 

1  =  (9  +  P)3  =  <73  +  3  pq2  +  3  p2q  +  p3, 
and  so 

3 q2p  -  1  =  -(p3  +  3 qp2  +  q3). 

Thus,  0  =  n(0)  may  be  written  as 

p303  +  3 qp292  -  (p3  4-  3 qp2  +  q3)9  4-  q3  =  0.  (*) 

(ii)  The  mean  of  X  is  p  =  3p.  So  when  p  >  J,  the 
probability  0*  of  ultimate  extinction  is  the  smallest  positive 
solution  of  0  =  n(0).  Since  0  =  1  is  a  solution  of  this 
equation,  we  can  factorize  the  left-hand  side  of  (*): 

(6  -  1  Xp302  +  (3 qp1  +  p3)0  -  q3)  =  0; 
thus,  the  quadratic  equation  satisfied  by  d*  when  p  >  (  is 
p392  +  (3 qp2  +  p3)8  -  q3  =  0.  (f) 

(iii)  When  p  =  |  ( >  ^),  the  equation  (f )  satisfied  by  9* 
becomes 

02  +  40  -  1  =  0; 

so  0  =  y^5  —  2  or  0  =  —y/5  —  2.  Hence,  0*  =  0.236,  the 
probability  of  ultimate  extinction. 


4.4  The  p.g.f.  of  the  offspring  distribution  is 
H(s)  =  0.2(1  +  s  -f  s2  +  53  +  s4). 

By  symmetry,  the  mean  is  equal  to  2,  so  extinction  is  not 
certain.  The  probability  of  ultimate  extinction  0*  is  the 
smallest  positive  root  of  0  =  n(0),  which  is 

0  =  0.2(1  +  0  +  02  4-  03  +  04), 
that  is, 

04  4-  03  4-  02  -  40  4-  1  =  0. 


Let  g(x)  =  x4  4-  x3  4-  x2  -  4x  4-  1;  then 
g'(x)  =  4x3  4-  3x2  4-  2x  —  4, 
and  the  Newton-Raphson  iteration  formula  is 


x 


71+1 


=  X„  — 


.  x*  +  x3  +  X2  -  4xn  +  1 


4x3  +  3x2  +  2x„  —  4 
Starting  with  x0  =  0,  we  obtain 
x0  =  0, 

Xj  =  0.25, 
x2  =  0.275, 
x3  =  0.2757, 
x4  =  0.2757. 


The  probability  of  extinction  is  0.276. 


(Y ou  may  have  factorized  04  4-  03  4-  02  —  40  4-  1  to  give 
(0  —  1X03  +  2 02  4-  30  —  1)  and  then  taken 

g(x)  =  x3  4-  2x2  +  3x  —  1. 

The  same  limit  is  reached.) 


The  slower  method  is  to  calculate  the  sequence  {0„}  where 
0n  +  1  =  n(0J.  In  this  case, 


0o  —  0, 

0i  =  0.2, 

02  =  0.25, 

03  =  0.266, 

04  =  0.272, 

05  =  0.274, 

The  same  probability  of  extinction  is  obtained. 
The  distribution  is  illustrated  in  Figure  1.4(ii). 


06  =  0.275, 
07  =  0.2754, 
98  =  0.2756, 
09  =  0.2757, 
01O  =  0.2757. 


Section  5 

5.1  Since  Zn  l,  Zn  2 , . . . ,  Zn  k  are  independent  and 
identically  distributed, 

E(Sn)  =  kE(Zn ,)  and  V(Sn)  =  k  V(ZJ. 

Expressions  for  the  mean  and  variance  of  Zn  i  are  given  by 
Equations  (3.6)  and  (3.9),  so 

£(SJ  =  kp", 

r  bV'V-i) 

K(S„)  =  \  fi  - 1  ^  # 

I  ktux2  p  =  1. 

5.2  Since  n„*(s)  =  +(s)  II*_  ,(n(s)), 

n;_i(s)  =  +(5)  2(n(s)); 

so 

n  i(s)  =  +(s)+(n(S))n„*-2(n(n(s))). 

Now  substituting  for  nj_2,  we  have 

ms)  =  ns)  xR(n(s))  ^(n(n(s)))  n?_  3(n(n(n(s)))), 

and  continuing  in  this  manner  we  obtain 

ms)  =  ns)  x  nm))  x ...  x  ^(nm...^^))...))) 
x  n(n(...(n(s))...)), 

where  the  penultimate  term  contains  (n  —  1)  ns  and  the  last  * 
term  contains  n  ns. 
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5.3  If  there  is  exactly  one  immigrant  at  each  generation, 
then,  for  each  generation,  the  p.g.f.  of  the  number  of 
immigrants  arriving  is  ^(s)  =  s.  So,  T(n(s))  =  FI(s).  Then  the 
result  of  Solution  5.2  gives 

nf  (s)  =  su(s\ 
n$(s)  =  sn(s)U(n(s))y 

TO  =  5  x  n (s)  x  u(U(s))  x  ...  x  n(n(...(n(s))...)), 

where  the  last  term  contains  n  FIs. 

Since  this  expression  for  n*(s)  is  a  product  of  n  +  1  terms, 
the  variate  Z*  can  be  thought  of  as  a  sum  of  n  +  1 
independent  variates.  The  first  variate,  with  p.g.f.  s,  is  equal 
to  1  and  corresponds  to  the  immigrant  who  has  just  arrived; 
the  second  variate,  with  p.g.f.  T7(s),  is  the  number  of 
descendants  of  the  immigrant  who  arrived  at  generation 
n-  1; ...  . 

The  penultimate  variate  is  the  number  of  (n  —  l)th 
generation  descendants  of  the  immigrant  who  arrived  at 
generation  1;  the  last  variate  is  the  number  of  descendants  of 
the  original  ancestor. 


5.4(i)  Using  the  product  rule  and  the  chain  rule  to 
differentiate 

n„*(s)  =  y(S)  n„*_  j(n(S)), 

we  obtain 

n„*'(s)  =  4',(s)n„*_1(n(s))  +  T(s)n,*:,(n(s))nw 

Setting  s  =  1,  we  have 

H*  =  v  +  nf-  in  (*) 

since  n(l)  = 'P(l)  =  n?_,(l)  =  1. 

(ii)  Replacing  n  by  n  —  1  in  formula  (*)  gives 

/C-1  =  V  + 

So 

rtf  =  V  +  H{v  +  rtf- art- 
Continuing  this  process,  we  obtain 

rtf  =  V  +  fiv  +  fi2(v  +  rtf- art 

=  v  +  fiv  +  n2v  + ...  +  rt'2v  +  rt  V* ■ 

Since  Z\  —  Wt  +  Zl9  taking  expectations  gives 
MT  =  E(Z  T)  =  E(W{)  +  E(Z,) 

=  v  +  fl. 

So  n*  =  v(l  +  n  +  Li2  +  ...  +  +  nn. 
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